Jun 13 05:24:24.894419 ip-10-0-138-93 systemd[1]: Starting Kubernetes Kubelet... Jun 13 05:24:25.319507 ip-10-0-138-93 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 05:24:25.319507 ip-10-0-138-93 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 13 05:24:25.319507 ip-10-0-138-93 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 05:24:25.319507 ip-10-0-138-93 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 13 05:24:25.319507 ip-10-0-138-93 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 13 05:24:25.320532 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.320441 2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 13 05:24:25.325785 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325763 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:25.325785 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325784 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:25.325785 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325789 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325792 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325795 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325798 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325801 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325804 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325807 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325809 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325812 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325815 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325817 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325819 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325822 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325824 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325831 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325834 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325837 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325839 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325842 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325844 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:25.325897 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325846 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325849 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325851 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325854 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325856 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325858 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325861 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325863 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325865 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325868 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325870 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325873 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325875 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325880 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325883 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325886 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325888 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325891 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325895 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:25.326417 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325899 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325902 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325905 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325908 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325911 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325914 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325917 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325921 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325923 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325926 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325928 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325931 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325934 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325936 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325939 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325942 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325944 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325947 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325949 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325951 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:25.326899 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325954 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325956 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325959 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325963 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325966 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325968 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325972 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325976 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325979 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325982 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325985 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325988 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325991 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325993 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.325995 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326019 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326023 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326028 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326032 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:25.327447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326035 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326038 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326041 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326043 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326046 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326049 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326052 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326055 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326057 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326060 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326062 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326065 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326083 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326089 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326093 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326097 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326101 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326116 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326119 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326857 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:25.327917 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326863 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326866 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326869 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326872 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326875 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326877 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326880 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326883 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326885 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326888 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326891 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326894 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326896 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326899 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326902 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326905 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326907 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326910 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326913 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:25.328446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326915 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326918 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326920 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326923 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326925 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326928 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326930 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326932 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326935 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326938 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326940 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326943 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326945 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326948 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326951 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326953 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326958 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326962 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326965 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326967 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:25.328921 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326970 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326973 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326975 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326977 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326980 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326982 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326985 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326988 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326991 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326993 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326996 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.326999 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327001 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327004 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327006 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327009 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327011 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327014 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327016 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327019 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327021 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:25.329452 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327024 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327026 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327029 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327032 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327034 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327037 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327039 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327042 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327045 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327049 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327053 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327055 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327058 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327061 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327063 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327066 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327083 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327086 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327089 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:25.329964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327091 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327095 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327097 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327100 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327103 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327107 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327110 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327112 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327114 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327121 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327123 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327126 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327129 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327131 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327134 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327137 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327139 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327142 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327145 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327522 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:25.330472 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327527 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327530 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327533 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327537 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327541 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327544 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327546 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327549 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327551 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327554 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327557 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327559 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327561 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327564 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327567 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327570 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327572 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327575 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327577 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:25.330976 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327579 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327582 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327585 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327588 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327590 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327593 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327597 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327600 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327602 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327604 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327607 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327609 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327612 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327614 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327617 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327619 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327622 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327624 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327627 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327629 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:25.331447 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327632 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327634 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327637 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327639 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327642 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327644 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327646 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327650 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327653 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327655 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327657 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327661 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327665 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327668 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327671 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327673 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327676 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327679 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327682 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:25.331941 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327685 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327687 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327690 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327692 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327695 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327698 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327700 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327703 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327705 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327708 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327710 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327712 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327715 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327718 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327720 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327722 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327725 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327728 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327730 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327734 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:25.332475 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327737 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327741 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327744 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327747 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327749 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327752 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327755 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327758 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327761 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327763 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327766 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327772 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327775 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327777 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327780 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327783 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327785 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327788 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327790 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.327792 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327870 2584 flags.go:64] FLAG: --address="0.0.0.0" Jun 13 05:24:25.332974 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327878 2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327884 2584 flags.go:64] FLAG: --anonymous-auth="true" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327889 2584 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327893 2584 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327896 2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327900 2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327904 2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327907 2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327910 2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327913 2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327916 2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327919 2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327922 2584 flags.go:64] FLAG: --cgroup-root="" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327926 2584 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327929 2584 flags.go:64] FLAG: --client-ca-file="" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327932 2584 flags.go:64] FLAG: --cloud-provider="external" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327935 2584 flags.go:64] FLAG: --cluster-dns="[]" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327939 2584 flags.go:64] FLAG: --cluster-domain="" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327942 2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327945 2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327948 2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327951 2584 flags.go:64] FLAG: --container-log-max-files="5" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327956 2584 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 13 05:24:25.333496 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327959 2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327962 2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327965 2584 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327968 2584 flags.go:64] FLAG: --contention-profiling="false" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327971 2584 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327974 2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327977 2584 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327980 2584 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327983 2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327986 2584 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327989 2584 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327992 2584 flags.go:64] FLAG: --enable-load-reader="false" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327995 2584 flags.go:64] FLAG: --enable-server="true" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.327998 2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328002 2584 flags.go:64] FLAG: --event-burst="100" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328005 2584 flags.go:64] FLAG: --event-qps="50" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328008 2584 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328011 2584 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328014 2584 flags.go:64] FLAG: --eviction-hard="" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328018 2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328021 2584 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328023 2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328026 2584 flags.go:64] FLAG: --eviction-soft="" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328030 2584 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328032 2584 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 13 05:24:25.334045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328035 2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328039 2584 flags.go:64] FLAG: --experimental-mounter-path="" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328042 2584 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328045 2584 flags.go:64] FLAG: --fail-swap-on="true" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328048 2584 flags.go:64] FLAG: --feature-gates="" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328052 2584 flags.go:64] FLAG: --file-check-frequency="20s" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328057 2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328060 2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328063 2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328066 2584 flags.go:64] FLAG: --healthz-port="10248" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328082 2584 flags.go:64] FLAG: --help="false" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328085 2584 flags.go:64] FLAG: --hostname-override="ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328088 2584 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328092 2584 flags.go:64] FLAG: --http-check-frequency="20s" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328094 2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328098 2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328101 2584 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328104 2584 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328107 2584 flags.go:64] FLAG: --image-service-endpoint="" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328110 2584 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328113 2584 flags.go:64] FLAG: --kube-api-burst="100" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328115 2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328118 2584 flags.go:64] FLAG: --kube-api-qps="50" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328121 2584 flags.go:64] FLAG: --kube-reserved="" Jun 13 05:24:25.334703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328124 2584 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328127 2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328130 2584 flags.go:64] FLAG: --kubelet-cgroups="" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328133 2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328136 2584 flags.go:64] FLAG: --lock-file="" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328138 2584 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328141 2584 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328145 2584 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328150 2584 flags.go:64] FLAG: --log-json-split-stream="false" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328154 2584 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328157 2584 flags.go:64] FLAG: --log-text-split-stream="false" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328160 2584 flags.go:64] FLAG: --logging-format="text" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328163 2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328166 2584 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328169 2584 flags.go:64] FLAG: --manifest-url="" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328172 2584 flags.go:64] FLAG: --manifest-url-header="" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328177 2584 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328180 2584 flags.go:64] FLAG: --max-open-files="1000000" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328184 2584 flags.go:64] FLAG: --max-pods="110" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328187 2584 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328190 2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328193 2584 flags.go:64] FLAG: --memory-manager-policy="None" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328196 2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328199 2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328202 2584 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 13 05:24:25.335318 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328204 2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328211 2584 flags.go:64] FLAG: --node-status-max-images="50" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328214 2584 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328217 2584 flags.go:64] FLAG: --oom-score-adj="-999" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328220 2584 flags.go:64] FLAG: --pod-cidr="" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328222 2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328228 2584 flags.go:64] FLAG: --pod-manifest-path="" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328231 2584 flags.go:64] FLAG: --pod-max-pids="-1" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328234 2584 flags.go:64] FLAG: --pods-per-core="0" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328237 2584 flags.go:64] FLAG: --port="10250" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328239 2584 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328242 2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-085e7cdffd2c59aea" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328245 2584 flags.go:64] FLAG: --qos-reserved="" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328248 2584 flags.go:64] FLAG: --read-only-port="10255" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328251 2584 flags.go:64] FLAG: --register-node="true" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328254 2584 flags.go:64] FLAG: --register-with-taints="" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328259 2584 flags.go:64] FLAG: --registry-burst="10" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328262 2584 flags.go:64] FLAG: --registry-qps="5" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328265 2584 flags.go:64] FLAG: --reserved-cpus="" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328267 2584 flags.go:64] FLAG: --reserved-memory="" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328271 2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328274 2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328278 2584 flags.go:64] FLAG: --rotate-certificates="false" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328281 2584 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328284 2584 flags.go:64] FLAG: --runonce="false" Jun 13 05:24:25.335970 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328287 2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328290 2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328292 2584 flags.go:64] FLAG: --seccomp-default="false" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328295 2584 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328298 2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328301 2584 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328304 2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328307 2584 flags.go:64] FLAG: --storage-driver-password="root" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328310 2584 flags.go:64] FLAG: --storage-driver-secure="false" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328313 2584 flags.go:64] FLAG: --storage-driver-table="stats" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328315 2584 flags.go:64] FLAG: --storage-driver-user="root" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328318 2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328321 2584 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328324 2584 flags.go:64] FLAG: --system-cgroups="" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328326 2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328332 2584 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328334 2584 flags.go:64] FLAG: --tls-cert-file="" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328337 2584 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328342 2584 flags.go:64] FLAG: --tls-min-version="" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328344 2584 flags.go:64] FLAG: --tls-private-key-file="" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328347 2584 flags.go:64] FLAG: --topology-manager-policy="none" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328350 2584 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328353 2584 flags.go:64] FLAG: --topology-manager-scope="container" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328362 2584 flags.go:64] FLAG: --v="2" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328366 2584 flags.go:64] FLAG: --version="false" Jun 13 05:24:25.336621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328371 2584 flags.go:64] FLAG: --vmodule="" Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328374 2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.328377 2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328494 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328499 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328502 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328505 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328507 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328510 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328512 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328515 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328517 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328520 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328524 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328527 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328531 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328534 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328537 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328539 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328542 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:25.337340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328545 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328548 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328551 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328553 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328556 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328558 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328561 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328563 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328566 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328568 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328572 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328576 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328579 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328581 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328584 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328586 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328591 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328593 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328596 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328598 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:25.337837 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328601 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328604 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328606 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328608 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328611 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328613 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328616 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328618 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328620 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328623 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328626 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328630 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328633 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328636 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328638 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328641 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328644 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328646 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328649 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328651 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:25.338515 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328654 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328656 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328660 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328663 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328665 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328669 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328672 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328675 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328678 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328681 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328683 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328686 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328688 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328690 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328693 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328695 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328698 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328700 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328703 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:25.339323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328705 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328707 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328710 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328713 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328715 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328718 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328720 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328722 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328725 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328727 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328730 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328733 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328735 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328737 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328740 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328744 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328747 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328749 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328752 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328754 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:25.339811 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328757 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328761 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.328764 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.329346 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.339749 2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.339767 2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.339787 2584 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.339793 2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339852 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339858 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339861 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339864 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339867 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339870 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339873 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:25.340338 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339876 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339879 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339882 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339884 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339887 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339889 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339892 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339896 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339898 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339901 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339903 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339906 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339909 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339912 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339914 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339917 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339920 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339922 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339926 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:25.340723 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339930 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339934 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339937 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339939 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339942 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339944 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339947 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339949 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339952 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339955 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339957 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339960 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339963 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339965 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339968 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339970 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339973 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339975 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339978 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339980 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:25.341297 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339984 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339988 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339991 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339995 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.339998 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340001 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340004 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340006 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340009 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340012 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340014 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340017 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340020 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340023 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340026 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340029 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340031 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340034 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340037 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:25.341796 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340039 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340042 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340044 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340046 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340049 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340051 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340053 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340056 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340058 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340061 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340063 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340065 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340088 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340092 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340097 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340100 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340103 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340105 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340108 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:25.342317 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340110 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340113 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340115 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340118 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340120 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340123 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340126 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340129 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340131 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340134 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340136 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340140 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340142 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340145 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340147 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:25.342792 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.340152 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340275 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340280 2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340283 2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340286 2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340289 2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340292 2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340296 2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340300 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340303 2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340306 2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340309 2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340312 2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340315 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340317 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340320 2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340323 2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340325 2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340328 2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 13 05:24:25.343197 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340330 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340333 2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340336 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340338 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340341 2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340344 2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340347 2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340350 2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340353 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340355 2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340358 2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340361 2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340363 2584 feature_gate.go:328] unrecognized feature gate: Example2 Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340366 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340368 2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340371 2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340373 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340376 2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340378 2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340380 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 13 05:24:25.343659 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340382 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340385 2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340387 2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340390 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340392 2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340395 2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340397 2584 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340400 2584 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340403 2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340406 2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340408 2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340410 2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340413 2584 feature_gate.go:328] unrecognized feature gate: Example Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340415 2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340418 2584 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340421 2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340423 2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340426 2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340428 2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340431 2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 13 05:24:25.344170 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340434 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340436 2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340439 2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340441 2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340444 2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340446 2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340449 2584 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340451 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340453 2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340456 2584 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340458 2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340460 2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340463 2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340465 2584 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340468 2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340470 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340473 2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340475 2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340477 2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340480 2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 13 05:24:25.344673 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340483 2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340485 2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340488 2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340490 2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340492 2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340494 2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340499 2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340502 2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340506 2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340509 2584 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340511 2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340515 2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340518 2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340521 2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340524 2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340526 2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340529 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340532 2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340534 2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 13 05:24:25.345300 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340537 2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 13 05:24:25.345785 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:25.340539 2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 13 05:24:25.345785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.340544 2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 13 05:24:25.345785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.340673 2584 server.go:962] "Client rotation is on, will bootstrap in background" Jun 13 05:24:25.345785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.343830 2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 13 05:24:25.345785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.345177 2584 server.go:1019] "Starting client certificate rotation" Jun 13 05:24:25.345785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.345277 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 05:24:25.345785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.345311 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 13 05:24:25.347807 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.347790 2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 05:24:25.349918 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.349903 2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 13 05:24:25.361016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.360991 2584 log.go:25] "Validated CRI v1 runtime API" Jun 13 05:24:25.364114 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.364097 2584 log.go:25] "Validated CRI v1 image API" Jun 13 05:24:25.364952 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.364935 2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 13 05:24:25.369944 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.369920 2584 fs.go:135] Filesystem UUIDs: map[4caa3c5d-71ee-40c0-bae6-c38ab70b8f76:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e566b552-9255-4d25-9730-ba31a7c77d71:/dev/nvme0n1p3] Jun 13 05:24:25.370004 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.369943 2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 13 05:24:25.377664 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.377546 2584 manager.go:216] Machine: {Timestamp:2026-06-13 05:24:25.376128933 +0000 UTC m=+0.356072818 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100411 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cc4aaa5c10779f0190b97237b64b7 SystemUUID:ec2cc4aa-a5c1-0779-f019-0b97237b64b7 BootID:aa2f9893-ff90-412d-a80b-c141383fef3d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:65:70:68:ff Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:65:70:68:ff Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:94:2d:b1:c5:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 13 05:24:25.377664 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.377657 2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 13 05:24:25.377784 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.377758 2584 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 13 05:24:25.380601 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.380569 2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 13 05:24:25.380750 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.380607 2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 13 05:24:25.381314 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.381303 2584 topology_manager.go:138] "Creating topology manager with none policy" Jun 13 05:24:25.381347 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.381317 2584 container_manager_linux.go:309] "Creating device plugin manager" Jun 13 05:24:25.381347 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.381328 2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 05:24:25.382029 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.382017 2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 13 05:24:25.383320 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.383308 2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 13 05:24:25.386279 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.386265 2584 state_mem.go:36] "Initialized new in-memory state store" Jun 13 05:24:25.386317 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.386302 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 05:24:25.386408 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.386398 2584 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 13 05:24:25.386452 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.386425 2584 kubelet.go:486] "Attempting to sync node with API server" Jun 13 05:24:25.386452 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.386435 2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 13 05:24:25.386452 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.386448 2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 13 05:24:25.386554 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.386478 2584 kubelet.go:398] "Adding apiserver pod source" Jun 13 05:24:25.386554 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.386488 2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 13 05:24:25.387021 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.387006 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 05:24:25.387096 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.387030 2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 13 05:24:25.389182 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.389147 2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 13 05:24:25.392499 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.392469 2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 13 05:24:25.392609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.392524 2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 13 05:24:25.393229 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393208 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 13 05:24:25.393307 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393234 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 13 05:24:25.393307 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393244 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 13 05:24:25.393307 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393251 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 13 05:24:25.393307 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393262 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 13 05:24:25.393307 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393267 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 13 05:24:25.393797 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393787 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 13 05:24:25.393797 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393796 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 13 05:24:25.393849 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393804 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 13 05:24:25.393849 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393809 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 13 05:24:25.393849 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393818 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 13 05:24:25.393849 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.393825 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 13 05:24:25.394618 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.394607 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 13 05:24:25.394658 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.394622 2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 13 05:24:25.398234 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.398216 2584 server.go:1268] "Started kubelet" Jun 13 05:24:25.398396 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.398337 2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 13 05:24:25.398477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.398375 2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 13 05:24:25.398477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.398448 2584 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 13 05:24:25.399903 ip-10-0-138-93 systemd[1]: Started Kubernetes Kubelet. Jun 13 05:24:25.400040 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.399995 2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 13 05:24:25.401143 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.401124 2584 server.go:310] "Adding debug handlers to kubelet server" Jun 13 05:24:25.401543 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.401523 2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 13 05:24:25.401979 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.401952 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 13 05:24:25.402066 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.401953 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 13 05:24:25.404457 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.403429 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-93.ec2.internal.18b88c9e976bfa2b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-93.ec2.internal,UID:ip-10-0-138-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-93.ec2.internal,},FirstTimestamp:2026-06-13 05:24:25.398188587 +0000 UTC m=+0.378132471,LastTimestamp:2026-06-13 05:24:25.398188587 +0000 UTC m=+0.378132471,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-93.ec2.internal,}" Jun 13 05:24:25.404986 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.404967 2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 13 05:24:25.404986 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.404977 2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 13 05:24:25.405128 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.405110 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:25.405630 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.405610 2584 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 13 05:24:25.405630 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.405632 2584 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 13 05:24:25.405768 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.405612 2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 13 05:24:25.405768 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.405716 2584 reconstruct.go:97] "Volume reconstruction finished" Jun 13 05:24:25.405768 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.405724 2584 reconciler.go:29] "Reconciler: start to sync state" Jun 13 05:24:25.408978 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.408952 2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 13 05:24:25.411021 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.411001 2584 factory.go:55] Registering systemd factory Jun 13 05:24:25.411150 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.411027 2584 factory.go:223] Registration of the systemd container factory successfully Jun 13 05:24:25.411301 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.411286 2584 factory.go:153] Registering CRI-O factory Jun 13 05:24:25.411353 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.411305 2584 factory.go:223] Registration of the crio container factory successfully Jun 13 05:24:25.411393 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.411361 2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 13 05:24:25.411393 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.411386 2584 factory.go:103] Registering Raw factory Jun 13 05:24:25.411473 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.411401 2584 manager.go:1196] Started watching for new ooms in manager Jun 13 05:24:25.411864 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.411849 2584 manager.go:349] Starting recovery of all containers Jun 13 05:24:25.413931 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.413892 2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 13 05:24:25.413931 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.413894 2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 13 05:24:25.417939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.417735 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 13 05:24:25.424437 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.424418 2584 manager.go:354] Recovery completed Jun 13 05:24:25.428990 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.428972 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:25.431031 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.431007 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:25.431125 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.431039 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:25.431125 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.431049 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:25.431666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.431651 2584 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 13 05:24:25.431666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.431666 2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 13 05:24:25.431783 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.431686 2584 state_mem.go:36] "Initialized new in-memory state store" Jun 13 05:24:25.431783 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.431656 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:25.432622 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.432604 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:25.432704 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.432642 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:25.432704 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.432658 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:25.432913 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.432897 2584 policy_none.go:49] "None policy: Start" Jun 13 05:24:25.432913 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.432915 2584 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 13 05:24:25.433006 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.432926 2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 13 05:24:25.433128 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.433037 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-93.ec2.internal.18b88c9e99610979 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-93.ec2.internal,UID:ip-10-0-138-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-93.ec2.internal,},FirstTimestamp:2026-06-13 05:24:25.431026041 +0000 UTC m=+0.410969925,LastTimestamp:2026-06-13 05:24:25.431026041 +0000 UTC m=+0.410969925,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-93.ec2.internal,}" Jun 13 05:24:25.433878 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.433867 2584 policy_none.go:47] "Start" Jun 13 05:24:25.436345 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.436323 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxbns" Jun 13 05:24:25.442477 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.442394 2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-93.ec2.internal.18b88c9e9961506d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-93.ec2.internal,UID:ip-10-0-138-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-93.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-93.ec2.internal,},FirstTimestamp:2026-06-13 05:24:25.431044205 +0000 UTC m=+0.410988088,LastTimestamp:2026-06-13 05:24:25.431044205 +0000 UTC m=+0.410988088,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-93.ec2.internal,}" Jun 13 05:24:25.443741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.443723 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nxbns" Jun 13 05:24:25.472778 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.472759 2584 manager.go:337] "Starting Device Plugin manager" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.472807 2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.472820 2584 server.go:87] "Starting device plugin registration server" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.473143 2584 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.473157 2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.473227 2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.473327 2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.473337 2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.473852 2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.473896 2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.478365 2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.478400 2584 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.478418 2584 kubelet.go:2448] "Starting kubelet main sync loop" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.478446 2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 13 05:24:25.481299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.480975 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:25.574311 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.574202 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:25.575421 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.575404 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:25.575515 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.575435 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:25.575515 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.575445 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:25.575515 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.575468 2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.578572 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.578540 2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal"] Jun 13 05:24:25.578648 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.578618 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:25.579452 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.579436 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:25.579530 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.579467 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:25.579530 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.579481 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:25.580667 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.580653 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:25.580753 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.580740 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.580810 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.580775 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:25.581417 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.581400 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:25.581490 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.581427 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:25.581490 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.581437 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:25.581949 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.581934 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:25.581997 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.581967 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:25.581997 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.581980 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:25.582478 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.582452 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.582560 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.582490 2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 13 05:24:25.583179 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.583156 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientMemory" Jun 13 05:24:25.583285 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.583193 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 13 05:24:25.583285 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.583203 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeHasSufficientPID" Jun 13 05:24:25.585260 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.585244 2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.585359 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.585265 2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-93.ec2.internal\": node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:25.606935 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.606900 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/018a72ef60f374f9167b03569e934049-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal\" (UID: \"018a72ef60f374f9167b03569e934049\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.607107 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.606943 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/018a72ef60f374f9167b03569e934049-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal\" (UID: \"018a72ef60f374f9167b03569e934049\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.607107 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.606992 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccff225c871af651f16f48a149c73d62-config\") pod \"kube-apiserver-proxy-ip-10-0-138-93.ec2.internal\" (UID: \"ccff225c871af651f16f48a149c73d62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.607107 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.607049 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-93.ec2.internal\" not found" node="ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.611755 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.611736 2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-93.ec2.internal\" not found" node="ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.625368 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.625349 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:25.708124 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.708058 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/018a72ef60f374f9167b03569e934049-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal\" (UID: \"018a72ef60f374f9167b03569e934049\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.708124 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.708114 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/018a72ef60f374f9167b03569e934049-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal\" (UID: \"018a72ef60f374f9167b03569e934049\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.708325 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.708160 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccff225c871af651f16f48a149c73d62-config\") pod \"kube-apiserver-proxy-ip-10-0-138-93.ec2.internal\" (UID: \"ccff225c871af651f16f48a149c73d62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.708325 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.708167 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/018a72ef60f374f9167b03569e934049-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal\" (UID: \"018a72ef60f374f9167b03569e934049\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.708325 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.708164 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/018a72ef60f374f9167b03569e934049-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal\" (UID: \"018a72ef60f374f9167b03569e934049\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.708325 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.708193 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccff225c871af651f16f48a149c73d62-config\") pod \"kube-apiserver-proxy-ip-10-0-138-93.ec2.internal\" (UID: \"ccff225c871af651f16f48a149c73d62\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.726237 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.726206 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:25.827239 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.827177 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:25.909512 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.909487 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.915001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:25.914982 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" Jun 13 05:24:25.927625 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:25.927601 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:26.028193 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.028147 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:26.128771 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.128683 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:26.229216 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.229180 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:26.329801 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.329769 2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-93.ec2.internal\" not found" Jun 13 05:24:26.344907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.344878 2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 13 05:24:26.345063 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.345042 2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 13 05:24:26.366347 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.366308 2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:26.386940 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.386914 2584 apiserver.go:52] "Watching apiserver" Jun 13 05:24:26.396200 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.396173 2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 13 05:24:26.396884 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.396864 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nhw9l","openshift-cluster-node-tuning-operator/tuned-l6zzq","openshift-image-registry/node-ca-b26pl","openshift-multus/multus-6stm8","openshift-multus/network-metrics-daemon-trmhx","openshift-network-operator/iptables-alerter-wqsgn","openshift-ovn-kubernetes/ovnkube-node-8jcnk","kube-system/konnectivity-agent-h4nhg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm","openshift-dns/node-resolver-xjvfv","openshift-multus/multus-additional-cni-plugins-wvzzk","openshift-network-diagnostics/network-check-target-8cncf"] Jun 13 05:24:26.398750 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.398711 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018a72ef60f374f9167b03569e934049.slice/crio-79f084e7c03ce8994a1bb3a762cecd01eed20045add7efd0e8a4286ea9ac3c24 WatchSource:0}: Error finding container 79f084e7c03ce8994a1bb3a762cecd01eed20045add7efd0e8a4286ea9ac3c24: Status 404 returned error can't find the container with id 79f084e7c03ce8994a1bb3a762cecd01eed20045add7efd0e8a4286ea9ac3c24 Jun 13 05:24:26.399821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.399285 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.399821 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.399436 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccff225c871af651f16f48a149c73d62.slice/crio-8698575b00143c4d302c433ae5ba109791978dac6b143b9d35838f5caf0629a2 WatchSource:0}: Error finding container 8698575b00143c4d302c433ae5ba109791978dac6b143b9d35838f5caf0629a2: Status 404 returned error can't find the container with id 8698575b00143c4d302c433ae5ba109791978dac6b143b9d35838f5caf0629a2 Jun 13 05:24:26.401323 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.401033 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.402579 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.402426 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dwwzg\"" Jun 13 05:24:26.402579 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.402565 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 13 05:24:26.402688 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.402659 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 13 05:24:26.402781 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.402757 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.403244 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.403209 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 13 05:24:26.403510 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.403491 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 13 05:24:26.403593 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.403511 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 13 05:24:26.403811 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.403793 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qpc4d\"" Jun 13 05:24:26.404045 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.404026 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.404864 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.404847 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 13 05:24:26.405089 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.404985 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9tnx7\"" Jun 13 05:24:26.405154 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.405088 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 05:24:26.405154 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.405109 2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 13 05:24:26.405154 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.405143 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 13 05:24:26.405294 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.405250 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" Jun 13 05:24:26.405294 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.405263 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 13 05:24:26.405514 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.405493 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 13 05:24:26.405945 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.405827 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.406460 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.406439 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pmb4n\"" Jun 13 05:24:26.406701 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.406628 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 13 05:24:26.406701 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.406694 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 13 05:24:26.406845 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.406722 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 13 05:24:26.407184 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.407153 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:26.408355 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.408334 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.409445 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.409426 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.410648 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.410630 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.411391 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411373 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 13 05:24:26.411514 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411449 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 13 05:24:26.411514 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411449 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kqcjw\"" Jun 13 05:24:26.411770 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-netns\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.411804 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411788 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-kubelet\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.411845 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411815 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-cni-netd\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.411900 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411843 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysctl-conf\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.411900 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411872 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-systemd-units\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.411998 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411897 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysconfig\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.411998 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411924 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-kubernetes\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.411998 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411949 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-sys\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.411998 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.411975 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-os-release\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412001 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shngf\" (UniqueName: \"kubernetes.io/projected/574a82e9-af75-4951-8aa8-25f7e73515bd-kube-api-access-shngf\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412037 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412026 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412094 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-log-socket\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.412119 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412128 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-run\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412173 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pgj8\" (UniqueName: \"kubernetes.io/projected/b0edb2ce-52ec-43f4-9884-b7246b431ab8-kube-api-access-7pgj8\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412199 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b2682ad-26c1-430c-906c-87fd647f456f-host\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412221 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-hostroot\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412244 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-multus-certs\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412267 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-slash\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412289 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-ovnkube-script-lib\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412312 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysctl-d\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412333 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-cnibin\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412355 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412372 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412391 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 13 05:24:26.412464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412355 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-k8s-cni-cncf-io\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412519 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-conf-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412536 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2895ffcc-4caf-4f60-826e-fc5edefd652f-iptables-alerter-script\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412554 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-cni-bin\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412569 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0edb2ce-52ec-43f4-9884-b7246b431ab8-tmp\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412591 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b2682ad-26c1-430c-906c-87fd647f456f-serviceca\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412613 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-modprobe-d\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412652 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412651 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/574a82e9-af75-4951-8aa8-25f7e73515bd-cni-binary-copy\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-cni-bin\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412723 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6kf2k\"" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412738 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-etc-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412763 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-node-log\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412785 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412785 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d374972-c83c-4e5c-8f76-df2bcf171205-ovn-node-metrics-cert\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412849 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-ovnkube-config\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412874 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-cni-multus\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412898 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-socket-dir-parent\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412911 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 13 05:24:26.413316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412913 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkltf\" (UniqueName: \"kubernetes.io/projected/2d374972-c83c-4e5c-8f76-df2bcf171205-kube-api-access-mkltf\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412935 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-lib-modules\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412966 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-host\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.412997 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413031 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-ovn\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413053 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-var-lib-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413106 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-cni-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413128 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-etc-kubernetes\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413149 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-tuned\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413171 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rq4n\" (UniqueName: \"kubernetes.io/projected/1b2682ad-26c1-430c-906c-87fd647f456f-kube-api-access-8rq4n\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413207 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-system-cni-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413261 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4t9c\" (UniqueName: \"kubernetes.io/projected/2895ffcc-4caf-4f60-826e-fc5edefd652f-kube-api-access-p4t9c\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413283 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-systemd\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413306 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413327 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-env-overrides\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413345 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413347 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-systemd\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.413946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413408 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-var-lib-kubelet\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.413408 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413429 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-daemon-config\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413450 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2895ffcc-4caf-4f60-826e-fc5edefd652f-host-slash\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413465 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-kubelet\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.413480 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-run-netns\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.414458 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.414525 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.414542 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 13 05:24:26.414774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.414550 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 13 05:24:26.417396 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.417357 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 13 05:24:26.417488 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.417453 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-68l9t\"" Jun 13 05:24:26.417488 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.417471 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 13 05:24:26.417585 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.417527 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 13 05:24:26.417869 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.417852 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-ndqk6\"" Jun 13 05:24:26.418202 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.418182 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 13 05:24:26.418336 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.418269 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 13 05:24:26.418441 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.418425 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-br4tr\"" Jun 13 05:24:26.424025 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.423998 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal"] Jun 13 05:24:26.424141 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.424010 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 05:24:26.424206 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.424190 2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" Jun 13 05:24:26.425601 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.425582 2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 13 05:24:26.431820 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.431805 2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 13 05:24:26.431898 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.431877 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal"] Jun 13 05:24:26.443537 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.443518 2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xrx96" Jun 13 05:24:26.447389 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.447349 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-12 05:19:25 +0000 UTC" deadline="2028-01-25 16:09:27.083416385 +0000 UTC" Jun 13 05:24:26.447389 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.447387 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14194h45m0.636032959s" Jun 13 05:24:26.450232 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.450209 2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xrx96" Jun 13 05:24:26.482143 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.482084 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" event={"ID":"018a72ef60f374f9167b03569e934049","Type":"ContainerStarted","Data":"79f084e7c03ce8994a1bb3a762cecd01eed20045add7efd0e8a4286ea9ac3c24"} Jun 13 05:24:26.483192 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.483169 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" event={"ID":"ccff225c871af651f16f48a149c73d62","Type":"ContainerStarted","Data":"8698575b00143c4d302c433ae5ba109791978dac6b143b9d35838f5caf0629a2"} Jun 13 05:24:26.507167 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.507139 2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 13 05:24:26.514464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514436 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysctl-conf\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.514464 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514476 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-systemd-units\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.514699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514506 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-sys-fs\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.514699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514524 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.514699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514580 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-systemd-units\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.514699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514617 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysctl-conf\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.514699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514619 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d42a9998-9674-4087-b5f5-607ee9a3cf5b-kubelet-config\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.514699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514656 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysconfig\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.514699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514675 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-kubernetes\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.514699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514697 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-sys\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514714 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-os-release\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514723 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-kubernetes\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514698 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysconfig\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514730 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shngf\" (UniqueName: \"kubernetes.io/projected/574a82e9-af75-4951-8aa8-25f7e73515bd-kube-api-access-shngf\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514760 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514767 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-sys\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514784 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-tmp-dir\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514790 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-os-release\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514797 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-run-ovn-kubernetes\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514807 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-log-socket\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514830 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514848 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-log-socket\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514856 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-run\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514881 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pgj8\" (UniqueName: \"kubernetes.io/projected/b0edb2ce-52ec-43f4-9884-b7246b431ab8-kube-api-access-7pgj8\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514900 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-run\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514930 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b2682ad-26c1-430c-906c-87fd647f456f-host\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.514970 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b2682ad-26c1-430c-906c-87fd647f456f-host\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.515155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515011 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-hostroot\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515037 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-multus-certs\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515058 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-hostroot\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515060 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-slash\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515107 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-multus-certs\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515112 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-slash\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515123 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-ovnkube-script-lib\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515144 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysctl-d\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515160 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-cnibin\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515178 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-k8s-cni-cncf-io\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515205 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-conf-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515231 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2895ffcc-4caf-4f60-826e-fc5edefd652f-iptables-alerter-script\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515236 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-k8s-cni-cncf-io\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515241 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-cnibin\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-cni-bin\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515279 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-conf-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515287 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-hosts-file\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515304 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-sysctl-d\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.516001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515312 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-cnibin\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515341 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0edb2ce-52ec-43f4-9884-b7246b431ab8-tmp\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515364 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b2682ad-26c1-430c-906c-87fd647f456f-serviceca\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515315 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-cni-bin\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515387 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-registration-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515413 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-system-cni-dir\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515443 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-modprobe-d\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515467 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/574a82e9-af75-4951-8aa8-25f7e73515bd-cni-binary-copy\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515519 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-cni-bin\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515544 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-etc-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515569 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-node-log\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515595 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d374972-c83c-4e5c-8f76-df2bcf171205-ovn-node-metrics-cert\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515596 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-modprobe-d\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515620 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-socket-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515646 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-os-release\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515652 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-etc-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515690 2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 13 05:24:26.516774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515697 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-ovnkube-config\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515726 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-cni-multus\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515752 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515780 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515808 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-socket-dir-parent\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515838 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkltf\" (UniqueName: \"kubernetes.io/projected/2d374972-c83c-4e5c-8f76-df2bcf171205-kube-api-access-mkltf\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515860 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-ovnkube-script-lib\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515864 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515877 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2895ffcc-4caf-4f60-826e-fc5edefd652f-iptables-alerter-script\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515700 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-cni-bin\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515922 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d4ab06b-6c88-44fa-aee4-e66c1af57bf2-agent-certs\") pod \"konnectivity-agent-h4nhg\" (UID: \"2d4ab06b-6c88-44fa-aee4-e66c1af57bf2\") " pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515956 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-node-log\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515958 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-lib-modules\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515781 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1b2682ad-26c1-430c-906c-87fd647f456f-serviceca\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515993 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-host\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.515939 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-cni-multus\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516036 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516047 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/574a82e9-af75-4951-8aa8-25f7e73515bd-cni-binary-copy\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516059 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-lib-modules\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516088 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkmhp\" (UniqueName: \"kubernetes.io/projected/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-kube-api-access-pkmhp\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516141 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-socket-dir-parent\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516191 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d42a9998-9674-4087-b5f5-607ee9a3cf5b-dbus\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516203 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516212 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-host\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516223 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-ovnkube-config\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516250 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z6qt\" (UniqueName: \"kubernetes.io/projected/cd190152-b46d-4522-ac9d-cc8f64fae7d4-kube-api-access-9z6qt\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-ovn\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516296 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-var-lib-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516343 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-var-lib-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516340 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-ovn\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516362 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-cni-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516396 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-etc-kubernetes\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516414 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8xqf\" (UniqueName: \"kubernetes.io/projected/f94d4248-88b3-4ecd-bb00-94ce56032e70-kube-api-access-h8xqf\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516462 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.517961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516467 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-etc-kubernetes\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516472 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-cni-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516486 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-tuned\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516510 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rq4n\" (UniqueName: \"kubernetes.io/projected/1b2682ad-26c1-430c-906c-87fd647f456f-kube-api-access-8rq4n\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516526 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-system-cni-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516541 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4t9c\" (UniqueName: \"kubernetes.io/projected/2895ffcc-4caf-4f60-826e-fc5edefd652f-kube-api-access-p4t9c\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516563 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-systemd\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516586 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516591 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-system-cni-dir\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516619 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-env-overrides\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516636 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-systemd\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516642 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-systemd\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516671 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-run-openvswitch\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516669 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516702 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-var-lib-kubelet\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516721 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-systemd\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516725 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-daemon-config\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516751 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2895ffcc-4caf-4f60-826e-fc5edefd652f-host-slash\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.518448 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516775 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-kubelet\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516798 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-run-netns\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516812 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2895ffcc-4caf-4f60-826e-fc5edefd652f-host-slash\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516823 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw7nt\" (UniqueName: \"kubernetes.io/projected/de0008d7-97be-4936-94a9-0f811a899ad8-kube-api-access-tw7nt\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516849 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d4ab06b-6c88-44fa-aee4-e66c1af57bf2-konnectivity-ca\") pod \"konnectivity-agent-h4nhg\" (UID: \"2d4ab06b-6c88-44fa-aee4-e66c1af57bf2\") " pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516859 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-run-netns\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516765 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0edb2ce-52ec-43f4-9884-b7246b431ab8-var-lib-kubelet\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516878 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-kubelet\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516902 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516938 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-netns\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516965 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-kubelet\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516989 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-run-netns\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.516994 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-cni-netd\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.517021 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-device-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.517022 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/574a82e9-af75-4951-8aa8-25f7e73515bd-host-var-lib-kubelet\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.517051 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2d374972-c83c-4e5c-8f76-df2bcf171205-host-cni-netd\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.517031 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2d374972-c83c-4e5c-8f76-df2bcf171205-env-overrides\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.518939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.517049 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.519443 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.517209 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/574a82e9-af75-4951-8aa8-25f7e73515bd-multus-daemon-config\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.519443 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.519245 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0edb2ce-52ec-43f4-9884-b7246b431ab8-etc-tuned\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.519443 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.519336 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0edb2ce-52ec-43f4-9884-b7246b431ab8-tmp\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.519530 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.519462 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2d374972-c83c-4e5c-8f76-df2bcf171205-ovn-node-metrics-cert\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.526454 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.526423 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shngf\" (UniqueName: \"kubernetes.io/projected/574a82e9-af75-4951-8aa8-25f7e73515bd-kube-api-access-shngf\") pod \"multus-6stm8\" (UID: \"574a82e9-af75-4951-8aa8-25f7e73515bd\") " pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.526603 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.526429 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4t9c\" (UniqueName: \"kubernetes.io/projected/2895ffcc-4caf-4f60-826e-fc5edefd652f-kube-api-access-p4t9c\") pod \"iptables-alerter-wqsgn\" (UID: \"2895ffcc-4caf-4f60-826e-fc5edefd652f\") " pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.526735 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.526717 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkltf\" (UniqueName: \"kubernetes.io/projected/2d374972-c83c-4e5c-8f76-df2bcf171205-kube-api-access-mkltf\") pod \"ovnkube-node-8jcnk\" (UID: \"2d374972-c83c-4e5c-8f76-df2bcf171205\") " pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.526897 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.526877 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rq4n\" (UniqueName: \"kubernetes.io/projected/1b2682ad-26c1-430c-906c-87fd647f456f-kube-api-access-8rq4n\") pod \"node-ca-b26pl\" (UID: \"1b2682ad-26c1-430c-906c-87fd647f456f\") " pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.526937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.526880 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pgj8\" (UniqueName: \"kubernetes.io/projected/b0edb2ce-52ec-43f4-9884-b7246b431ab8-kube-api-access-7pgj8\") pod \"tuned-l6zzq\" (UID: \"b0edb2ce-52ec-43f4-9884-b7246b431ab8\") " pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.618018 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.617978 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-tmp-dir\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.618018 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618017 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618227 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618039 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-hosts-file\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.618227 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618110 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618227 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-cnibin\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618227 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618189 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-hosts-file\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.618227 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618196 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-registration-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618218 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-cnibin\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618247 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-registration-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618254 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-system-cni-dir\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618284 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-socket-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618291 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-system-cni-dir\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618300 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-os-release\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618326 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618342 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618358 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618377 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d4ab06b-6c88-44fa-aee4-e66c1af57bf2-agent-certs\") pod \"konnectivity-agent-h4nhg\" (UID: \"2d4ab06b-6c88-44fa-aee4-e66c1af57bf2\") " pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618384 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-socket-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618384 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-tmp-dir\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.618406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618403 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkmhp\" (UniqueName: \"kubernetes.io/projected/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-kube-api-access-pkmhp\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618441 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-os-release\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618506 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d42a9998-9674-4087-b5f5-607ee9a3cf5b-dbus\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618521 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-etc-selinux\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618537 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z6qt\" (UniqueName: \"kubernetes.io/projected/cd190152-b46d-4522-ac9d-cc8f64fae7d4-kube-api-access-9z6qt\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618590 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8xqf\" (UniqueName: \"kubernetes.io/projected/f94d4248-88b3-4ecd-bb00-94ce56032e70-kube-api-access-h8xqf\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618625 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618658 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618690 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw7nt\" (UniqueName: \"kubernetes.io/projected/de0008d7-97be-4936-94a9-0f811a899ad8-kube-api-access-tw7nt\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618692 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d42a9998-9674-4087-b5f5-607ee9a3cf5b-dbus\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618718 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d4ab06b-6c88-44fa-aee4-e66c1af57bf2-konnectivity-ca\") pod \"konnectivity-agent-h4nhg\" (UID: \"2d4ab06b-6c88-44fa-aee4-e66c1af57bf2\") " pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.618745 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.618870 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.618880 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret podName:d42a9998-9674-4087-b5f5-607ee9a3cf5b nodeName:}" failed. No retries permitted until 2026-06-13 05:24:27.118858683 +0000 UTC m=+2.098802577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret") pod "global-pull-secret-syncer-nhw9l" (UID: "d42a9998-9674-4087-b5f5-607ee9a3cf5b") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618901 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-device-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.618937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618937 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618974 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-sys-fs\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.618978 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619003 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.619038 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:27.11902073 +0000 UTC m=+2.098964614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619061 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-device-dir\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619062 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d42a9998-9674-4087-b5f5-607ee9a3cf5b-kubelet-config\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619107 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f94d4248-88b3-4ecd-bb00-94ce56032e70-sys-fs\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619182 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de0008d7-97be-4936-94a9-0f811a899ad8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619242 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-cni-binary-copy\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619257 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d4ab06b-6c88-44fa-aee4-e66c1af57bf2-konnectivity-ca\") pod \"konnectivity-agent-h4nhg\" (UID: \"2d4ab06b-6c88-44fa-aee4-e66c1af57bf2\") " pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619283 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d42a9998-9674-4087-b5f5-607ee9a3cf5b-kubelet-config\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:26.619741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.619602 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de0008d7-97be-4936-94a9-0f811a899ad8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.620822 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.620805 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d4ab06b-6c88-44fa-aee4-e66c1af57bf2-agent-certs\") pod \"konnectivity-agent-h4nhg\" (UID: \"2d4ab06b-6c88-44fa-aee4-e66c1af57bf2\") " pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:26.631373 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.631352 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:26.631373 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.631374 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:26.631549 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.631386 2584 projected.go:196] Error preparing data for projected volume kube-api-access-crql9 for pod openshift-network-diagnostics/network-check-target-8cncf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:26.631549 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:26.631447 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9 podName:118b5b23-7d4e-45cf-8e8e-e8f616ca40ed nodeName:}" failed. No retries permitted until 2026-06-13 05:24:27.131430303 +0000 UTC m=+2.111374192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-crql9" (UniqueName: "kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9") pod "network-check-target-8cncf" (UID: "118b5b23-7d4e-45cf-8e8e-e8f616ca40ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:26.633508 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.633478 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkmhp\" (UniqueName: \"kubernetes.io/projected/8dddcf0a-2034-4b38-a5c5-4592132ddc8a-kube-api-access-pkmhp\") pod \"node-resolver-xjvfv\" (UID: \"8dddcf0a-2034-4b38-a5c5-4592132ddc8a\") " pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.633774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.633745 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8xqf\" (UniqueName: \"kubernetes.io/projected/f94d4248-88b3-4ecd-bb00-94ce56032e70-kube-api-access-h8xqf\") pod \"aws-ebs-csi-driver-node-gkgzm\" (UID: \"f94d4248-88b3-4ecd-bb00-94ce56032e70\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.633906 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.633888 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw7nt\" (UniqueName: \"kubernetes.io/projected/de0008d7-97be-4936-94a9-0f811a899ad8-kube-api-access-tw7nt\") pod \"multus-additional-cni-plugins-wvzzk\" (UID: \"de0008d7-97be-4936-94a9-0f811a899ad8\") " pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.633975 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.633959 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z6qt\" (UniqueName: \"kubernetes.io/projected/cd190152-b46d-4522-ac9d-cc8f64fae7d4-kube-api-access-9z6qt\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:26.711800 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.711704 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" Jun 13 05:24:26.717689 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.717666 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b26pl" Jun 13 05:24:26.719986 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.719961 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0edb2ce_52ec_43f4_9884_b7246b431ab8.slice/crio-b99f83194e43f58feeeb95d413ed62cade0592bc309c64b2901f7be8ce55f36a WatchSource:0}: Error finding container b99f83194e43f58feeeb95d413ed62cade0592bc309c64b2901f7be8ce55f36a: Status 404 returned error can't find the container with id b99f83194e43f58feeeb95d413ed62cade0592bc309c64b2901f7be8ce55f36a Jun 13 05:24:26.725616 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.725589 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2682ad_26c1_430c_906c_87fd647f456f.slice/crio-c1da64ee324f72f3feddfb3b53e2bb8deb7029bdf292fbb7f61db8470d9338f0 WatchSource:0}: Error finding container c1da64ee324f72f3feddfb3b53e2bb8deb7029bdf292fbb7f61db8470d9338f0: Status 404 returned error can't find the container with id c1da64ee324f72f3feddfb3b53e2bb8deb7029bdf292fbb7f61db8470d9338f0 Jun 13 05:24:26.727391 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.727377 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6stm8" Jun 13 05:24:26.732658 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.732637 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wqsgn" Jun 13 05:24:26.732736 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.732723 2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:26.736446 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.736422 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod574a82e9_af75_4951_8aa8_25f7e73515bd.slice/crio-285a1eaa1a436a6d876231ebc0b1f86830e97c39485d4ba19aa6276703411480 WatchSource:0}: Error finding container 285a1eaa1a436a6d876231ebc0b1f86830e97c39485d4ba19aa6276703411480: Status 404 returned error can't find the container with id 285a1eaa1a436a6d876231ebc0b1f86830e97c39485d4ba19aa6276703411480 Jun 13 05:24:26.738179 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.738147 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:26.740961 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.740940 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2895ffcc_4caf_4f60_826e_fc5edefd652f.slice/crio-6213ce6b4b53e637254984a4e9ae51a6b006ad03b3ad819fd86fa251c3b3a45a WatchSource:0}: Error finding container 6213ce6b4b53e637254984a4e9ae51a6b006ad03b3ad819fd86fa251c3b3a45a: Status 404 returned error can't find the container with id 6213ce6b4b53e637254984a4e9ae51a6b006ad03b3ad819fd86fa251c3b3a45a Jun 13 05:24:26.745244 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.745227 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:26.745590 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.745571 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d374972_c83c_4e5c_8f76_df2bcf171205.slice/crio-4430acc0fce318b5fa24f47b5f09b462b236337068adf7867d88e884d804a66f WatchSource:0}: Error finding container 4430acc0fce318b5fa24f47b5f09b462b236337068adf7867d88e884d804a66f: Status 404 returned error can't find the container with id 4430acc0fce318b5fa24f47b5f09b462b236337068adf7867d88e884d804a66f Jun 13 05:24:26.751692 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.751650 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" Jun 13 05:24:26.752995 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.752974 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4ab06b_6c88_44fa_aee4_e66c1af57bf2.slice/crio-7cc6f8ed1a826d7f62660c065d699a0997e5deb4de17207845fe35797e20b51a WatchSource:0}: Error finding container 7cc6f8ed1a826d7f62660c065d699a0997e5deb4de17207845fe35797e20b51a: Status 404 returned error can't find the container with id 7cc6f8ed1a826d7f62660c065d699a0997e5deb4de17207845fe35797e20b51a Jun 13 05:24:26.755510 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.755488 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xjvfv" Jun 13 05:24:26.760541 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.760518 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" Jun 13 05:24:26.761288 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.761258 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf94d4248_88b3_4ecd_bb00_94ce56032e70.slice/crio-77a60c4e36a57f063ba79a62fb1f8b075b60b7970788d0fd4be37aee34713005 WatchSource:0}: Error finding container 77a60c4e36a57f063ba79a62fb1f8b075b60b7970788d0fd4be37aee34713005: Status 404 returned error can't find the container with id 77a60c4e36a57f063ba79a62fb1f8b075b60b7970788d0fd4be37aee34713005 Jun 13 05:24:26.764380 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.764354 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dddcf0a_2034_4b38_a5c5_4592132ddc8a.slice/crio-e29c7868798ec810ceefe387e38ec3e15925c3acce484010712811f626c55f64 WatchSource:0}: Error finding container e29c7868798ec810ceefe387e38ec3e15925c3acce484010712811f626c55f64: Status 404 returned error can't find the container with id e29c7868798ec810ceefe387e38ec3e15925c3acce484010712811f626c55f64 Jun 13 05:24:26.768726 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:24:26.768701 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde0008d7_97be_4936_94a9_0f811a899ad8.slice/crio-90411376bbd95eb28002a25a90b41b7e7768de5bc6a5e0677fba85767ee4b31b WatchSource:0}: Error finding container 90411376bbd95eb28002a25a90b41b7e7768de5bc6a5e0677fba85767ee4b31b: Status 404 returned error can't find the container with id 90411376bbd95eb28002a25a90b41b7e7768de5bc6a5e0677fba85767ee4b31b Jun 13 05:24:26.932294 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:26.932262 2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:27.123606 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.123568 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:27.123789 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.123627 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:27.123860 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.123790 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:27.123860 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.123853 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:28.123835218 +0000 UTC m=+3.103779104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:27.124267 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.124246 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:27.124354 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.124303 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret podName:d42a9998-9674-4087-b5f5-607ee9a3cf5b nodeName:}" failed. No retries permitted until 2026-06-13 05:24:28.124288948 +0000 UTC m=+3.104232825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret") pod "global-pull-secret-syncer-nhw9l" (UID: "d42a9998-9674-4087-b5f5-607ee9a3cf5b") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:27.225280 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.224182 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:27.225280 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.224399 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:27.225280 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.224418 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:27.225280 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.224430 2584 projected.go:196] Error preparing data for projected volume kube-api-access-crql9 for pod openshift-network-diagnostics/network-check-target-8cncf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:27.225280 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.224487 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9 podName:118b5b23-7d4e-45cf-8e8e-e8f616ca40ed nodeName:}" failed. No retries permitted until 2026-06-13 05:24:28.224469854 +0000 UTC m=+3.204413749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-crql9" (UniqueName: "kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9") pod "network-check-target-8cncf" (UID: "118b5b23-7d4e-45cf-8e8e-e8f616ca40ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:27.234064 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.234034 2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 13 05:24:27.452659 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.452547 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 05:19:26 +0000 UTC" deadline="2027-12-27 06:56:04.816941037 +0000 UTC" Jun 13 05:24:27.452659 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.452584 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13489h31m37.364360749s" Jun 13 05:24:27.481199 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.481163 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:27.481377 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:27.481299 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:27.530686 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.530639 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" event={"ID":"de0008d7-97be-4936-94a9-0f811a899ad8","Type":"ContainerStarted","Data":"90411376bbd95eb28002a25a90b41b7e7768de5bc6a5e0677fba85767ee4b31b"} Jun 13 05:24:27.545551 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.545517 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wqsgn" event={"ID":"2895ffcc-4caf-4f60-826e-fc5edefd652f","Type":"ContainerStarted","Data":"6213ce6b4b53e637254984a4e9ae51a6b006ad03b3ad819fd86fa251c3b3a45a"} Jun 13 05:24:27.559586 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.559417 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b26pl" event={"ID":"1b2682ad-26c1-430c-906c-87fd647f456f","Type":"ContainerStarted","Data":"c1da64ee324f72f3feddfb3b53e2bb8deb7029bdf292fbb7f61db8470d9338f0"} Jun 13 05:24:27.571542 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.571473 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" event={"ID":"b0edb2ce-52ec-43f4-9884-b7246b431ab8","Type":"ContainerStarted","Data":"b99f83194e43f58feeeb95d413ed62cade0592bc309c64b2901f7be8ce55f36a"} Jun 13 05:24:27.576341 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.576303 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xjvfv" event={"ID":"8dddcf0a-2034-4b38-a5c5-4592132ddc8a","Type":"ContainerStarted","Data":"e29c7868798ec810ceefe387e38ec3e15925c3acce484010712811f626c55f64"} Jun 13 05:24:27.596415 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.596367 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" event={"ID":"f94d4248-88b3-4ecd-bb00-94ce56032e70","Type":"ContainerStarted","Data":"77a60c4e36a57f063ba79a62fb1f8b075b60b7970788d0fd4be37aee34713005"} Jun 13 05:24:27.604309 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.604268 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h4nhg" event={"ID":"2d4ab06b-6c88-44fa-aee4-e66c1af57bf2","Type":"ContainerStarted","Data":"7cc6f8ed1a826d7f62660c065d699a0997e5deb4de17207845fe35797e20b51a"} Jun 13 05:24:27.631529 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.631483 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"4430acc0fce318b5fa24f47b5f09b462b236337068adf7867d88e884d804a66f"} Jun 13 05:24:27.642038 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:27.641984 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6stm8" event={"ID":"574a82e9-af75-4951-8aa8-25f7e73515bd","Type":"ContainerStarted","Data":"285a1eaa1a436a6d876231ebc0b1f86830e97c39485d4ba19aa6276703411480"} Jun 13 05:24:28.133436 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:28.132709 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:28.133436 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:28.132762 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:28.133436 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.132889 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:28.133436 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.132947 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:30.132930342 +0000 UTC m=+5.112874226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:28.133436 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.133345 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:28.133436 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.133392 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret podName:d42a9998-9674-4087-b5f5-607ee9a3cf5b nodeName:}" failed. No retries permitted until 2026-06-13 05:24:30.133377714 +0000 UTC m=+5.113321591 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret") pod "global-pull-secret-syncer-nhw9l" (UID: "d42a9998-9674-4087-b5f5-607ee9a3cf5b") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:28.233975 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:28.233936 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:28.234220 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.234203 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:28.234304 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.234231 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:28.234304 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.234246 2584 projected.go:196] Error preparing data for projected volume kube-api-access-crql9 for pod openshift-network-diagnostics/network-check-target-8cncf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:28.234413 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.234317 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9 podName:118b5b23-7d4e-45cf-8e8e-e8f616ca40ed nodeName:}" failed. No retries permitted until 2026-06-13 05:24:30.234297453 +0000 UTC m=+5.214241328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-crql9" (UniqueName: "kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9") pod "network-check-target-8cncf" (UID: "118b5b23-7d4e-45cf-8e8e-e8f616ca40ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:28.453351 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:28.453259 2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-12 05:19:26 +0000 UTC" deadline="2027-11-21 18:15:32.564972902 +0000 UTC" Jun 13 05:24:28.453351 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:28.453304 2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12636h51m4.111674519s" Jun 13 05:24:28.479352 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:28.478766 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:28.479352 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.478919 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:28.479352 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:28.479293 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:28.484710 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:28.480191 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:29.481816 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:29.481785 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:29.482416 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:29.481917 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:30.149104 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:30.149004 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:30.149104 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:30.149056 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:30.149313 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.149241 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:30.149313 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.149299 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:34.149285629 +0000 UTC m=+9.129229590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:30.149728 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.149699 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:30.149822 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.149754 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret podName:d42a9998-9674-4087-b5f5-607ee9a3cf5b nodeName:}" failed. No retries permitted until 2026-06-13 05:24:34.149740255 +0000 UTC m=+9.129684139 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret") pod "global-pull-secret-syncer-nhw9l" (UID: "d42a9998-9674-4087-b5f5-607ee9a3cf5b") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:30.250209 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:30.250168 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:30.250377 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.250339 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:30.250377 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.250360 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:30.250377 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.250371 2584 projected.go:196] Error preparing data for projected volume kube-api-access-crql9 for pod openshift-network-diagnostics/network-check-target-8cncf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:30.250544 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.250430 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9 podName:118b5b23-7d4e-45cf-8e8e-e8f616ca40ed nodeName:}" failed. No retries permitted until 2026-06-13 05:24:34.250410269 +0000 UTC m=+9.230354162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-crql9" (UniqueName: "kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9") pod "network-check-target-8cncf" (UID: "118b5b23-7d4e-45cf-8e8e-e8f616ca40ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:30.479139 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:30.479045 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:30.479295 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.479198 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:30.479689 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:30.479655 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:30.479801 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:30.479752 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:31.481799 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:31.481297 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:31.481799 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:31.481439 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:32.478802 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:32.478765 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:32.478973 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:32.478773 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:32.478973 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:32.478913 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:32.479116 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:32.479050 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:33.480217 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:33.480172 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:33.480632 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:33.480329 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:34.188304 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:34.188264 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:34.188490 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:34.188343 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:34.188490 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.188452 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:34.188611 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.188503 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret podName:d42a9998-9674-4087-b5f5-607ee9a3cf5b nodeName:}" failed. No retries permitted until 2026-06-13 05:24:42.18848757 +0000 UTC m=+17.168431441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret") pod "global-pull-secret-syncer-nhw9l" (UID: "d42a9998-9674-4087-b5f5-607ee9a3cf5b") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:34.188878 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.188786 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:34.188878 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.188856 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:42.18883855 +0000 UTC m=+17.168782427 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:34.289388 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:34.289340 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:34.289578 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.289536 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:34.289578 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.289563 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:34.289578 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.289573 2584 projected.go:196] Error preparing data for projected volume kube-api-access-crql9 for pod openshift-network-diagnostics/network-check-target-8cncf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:34.289735 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.289652 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9 podName:118b5b23-7d4e-45cf-8e8e-e8f616ca40ed nodeName:}" failed. No retries permitted until 2026-06-13 05:24:42.28962432 +0000 UTC m=+17.269568210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-crql9" (UniqueName: "kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9") pod "network-check-target-8cncf" (UID: "118b5b23-7d4e-45cf-8e8e-e8f616ca40ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:34.479680 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:34.479599 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:34.479825 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.479755 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:34.480159 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:34.480132 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:34.480268 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:34.480216 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:35.481378 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:35.481345 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:35.481708 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:35.481467 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:36.479338 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:36.479113 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:36.479511 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:36.479153 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:36.479511 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:36.479453 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:36.479620 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:36.479597 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:37.478794 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:37.478757 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:37.479284 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:37.478885 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:38.479298 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:38.479258 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:38.479663 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:38.479258 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:38.479663 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:38.479395 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:38.479663 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:38.479425 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:39.479779 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:39.479736 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:39.480265 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:39.479871 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:40.479467 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:40.479425 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:40.479467 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:40.479466 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:40.479703 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:40.479584 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:40.479755 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:40.479732 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:41.479535 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:41.479494 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:41.479995 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:41.479620 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:42.252975 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:42.252944 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:42.253212 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:42.252995 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:42.253212 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.253123 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:42.253212 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.253126 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:42.253212 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.253194 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:24:58.253172703 +0000 UTC m=+33.233116662 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:42.253212 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.253213 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret podName:d42a9998-9674-4087-b5f5-607ee9a3cf5b nodeName:}" failed. No retries permitted until 2026-06-13 05:24:58.253205103 +0000 UTC m=+33.233148977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret") pod "global-pull-secret-syncer-nhw9l" (UID: "d42a9998-9674-4087-b5f5-607ee9a3cf5b") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:42.353645 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:42.353592 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:42.353855 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.353740 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:42.353855 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.353768 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:42.353855 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.353781 2584 projected.go:196] Error preparing data for projected volume kube-api-access-crql9 for pod openshift-network-diagnostics/network-check-target-8cncf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:42.353855 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.353853 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9 podName:118b5b23-7d4e-45cf-8e8e-e8f616ca40ed nodeName:}" failed. No retries permitted until 2026-06-13 05:24:58.353835384 +0000 UTC m=+33.333779270 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-crql9" (UniqueName: "kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9") pod "network-check-target-8cncf" (UID: "118b5b23-7d4e-45cf-8e8e-e8f616ca40ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:42.478785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:42.478755 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:42.478995 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.478859 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:42.478995 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:42.478912 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:42.479106 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:42.479011 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:43.479310 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:43.479278 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:43.479823 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:43.479408 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:44.479452 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:44.479414 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:44.479452 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:44.479438 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:44.479923 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:44.479543 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:44.479923 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:44.479661 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:45.479366 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:45.479338 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:45.479565 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:45.479449 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:46.479255 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:46.479216 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:46.479427 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:46.479269 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:46.479427 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:46.479353 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:46.479539 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:46.479487 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:47.479146 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:47.479124 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:47.479489 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:47.479236 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:47.715987 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:47.715959 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6stm8" event={"ID":"574a82e9-af75-4951-8aa8-25f7e73515bd","Type":"ContainerStarted","Data":"e93aa867cb0e5b3137f14c029bfb939f6fa395b7c459c3424792e774c4233931"} Jun 13 05:24:47.721328 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:47.721278 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" event={"ID":"ccff225c871af651f16f48a149c73d62","Type":"ContainerStarted","Data":"d561903524925146fb76399c30e5ac736bd57e0018bc613dc1583dec7c574247"} Jun 13 05:24:47.725398 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:47.724873 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" event={"ID":"b0edb2ce-52ec-43f4-9884-b7246b431ab8","Type":"ContainerStarted","Data":"8d0f69b820ecedc69a6482d2210ec50a7645b431c3e8d0ac9680b747588c1bcc"} Jun 13 05:24:47.732399 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:47.732346 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6stm8" podStartSLOduration=2.308441353 podStartE2EDuration="22.7323281s" totalImagesPullingTime="20.423886747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:47.73184456 +0000 UTC m=+22.711788459" watchObservedRunningTime="2026-06-13 05:24:47.7323281 +0000 UTC m=+22.712271994" Jun 13 05:24:47.743948 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:47.743905 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-93.ec2.internal" podStartSLOduration=21.743887341 podStartE2EDuration="21.743887341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:47.743695644 +0000 UTC m=+22.723639537" watchObservedRunningTime="2026-06-13 05:24:47.743887341 +0000 UTC m=+22.723831234" Jun 13 05:24:47.759064 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:47.759017 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l6zzq" podStartSLOduration=2.323457644 podStartE2EDuration="22.759002529s" totalImagesPullingTime="20.435544885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:47.758498899 +0000 UTC m=+22.738442793" watchObservedRunningTime="2026-06-13 05:24:47.759002529 +0000 UTC m=+22.738946421" Jun 13 05:24:48.479420 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.479261 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:48.480177 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.479315 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:48.480177 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:48.479497 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:48.480177 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:48.479571 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:48.728227 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.728201 2584 generic.go:356] "Generic (PLEG): container finished" podID="018a72ef60f374f9167b03569e934049" containerID="0877d89098a5cd42139015a0eb5ad3e3be107152cb913a41991b4b6b19845f14" exitCode=0 Jun 13 05:24:48.728331 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.728294 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" event={"ID":"018a72ef60f374f9167b03569e934049","Type":"ContainerDied","Data":"0877d89098a5cd42139015a0eb5ad3e3be107152cb913a41991b4b6b19845f14"} Jun 13 05:24:48.729708 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.729676 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xjvfv" event={"ID":"8dddcf0a-2034-4b38-a5c5-4592132ddc8a","Type":"ContainerStarted","Data":"aca6b52ec5d40ae23178c0e89d6c1066161cf6a974e59147c6a9b118fdba4243"} Jun 13 05:24:48.731265 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.731245 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" event={"ID":"f94d4248-88b3-4ecd-bb00-94ce56032e70","Type":"ContainerStarted","Data":"e0b94977f6b8e29c602c555f543790878f8b9c63f49dd71d25a3270f41221458"} Jun 13 05:24:48.732640 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.732612 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h4nhg" event={"ID":"2d4ab06b-6c88-44fa-aee4-e66c1af57bf2","Type":"ContainerStarted","Data":"21e5c8c2de91f443bb7ac1bb708ecf99863aff3dbda75fdd3851a547f4c32273"} Jun 13 05:24:48.735192 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.735176 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:24:48.735485 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.735468 2584 generic.go:356] "Generic (PLEG): container finished" podID="2d374972-c83c-4e5c-8f76-df2bcf171205" containerID="e18a6082546bb9c2ff204574d8801db3d60ce24b8c698a0fe459538357dfb3d7" exitCode=1 Jun 13 05:24:48.735556 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.735532 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"54c20029d5657827f049276001ba0c0cf81cd1b3270e2f8d491ca173e13a4096"} Jun 13 05:24:48.735625 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.735607 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"414be569b08b6213efcffe228fe00ff72434dfea527d3d809d9081fd8cbdeace"} Jun 13 05:24:48.735681 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.735667 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"b8f56ec0174e6c2f23e174ee31ecf948d9aec2eb1da7cc13d056c5be19e35c2e"} Jun 13 05:24:48.735735 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.735722 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"6f552c2a7ea9af1dcff6c2fda703c5d45b9535e33fe6d6a6a3f65aa6bded8b6c"} Jun 13 05:24:48.735788 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.735757 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerDied","Data":"e18a6082546bb9c2ff204574d8801db3d60ce24b8c698a0fe459538357dfb3d7"} Jun 13 05:24:48.735843 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.735789 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"0cb546770777b4a9b59343baa3c34129350dd4640f74f0b92d41890a2150b403"} Jun 13 05:24:48.736931 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.736911 2584 generic.go:356] "Generic (PLEG): container finished" podID="de0008d7-97be-4936-94a9-0f811a899ad8" containerID="890ff9d966b04352cf383f18e45275583e4c3d4e69a358916cbcf697cc7d082b" exitCode=0 Jun 13 05:24:48.737001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.736939 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" event={"ID":"de0008d7-97be-4936-94a9-0f811a899ad8","Type":"ContainerDied","Data":"890ff9d966b04352cf383f18e45275583e4c3d4e69a358916cbcf697cc7d082b"} Jun 13 05:24:48.738311 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.738254 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wqsgn" event={"ID":"2895ffcc-4caf-4f60-826e-fc5edefd652f","Type":"ContainerStarted","Data":"44dc8bd17df3797794a36bcd6f7643677ee43544ff5c7a930a949add6aa3bc79"} Jun 13 05:24:48.739626 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.739603 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b26pl" event={"ID":"1b2682ad-26c1-430c-906c-87fd647f456f","Type":"ContainerStarted","Data":"11bb874d22536b4b94ee3d7310303610108e263f85210d27d92406af4f3b629b"} Jun 13 05:24:48.767803 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.767769 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b26pl" podStartSLOduration=3.335642915 podStartE2EDuration="23.767754139s" totalImagesPullingTime="20.432111224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:48.753702301 +0000 UTC m=+23.733646194" watchObservedRunningTime="2026-06-13 05:24:48.767754139 +0000 UTC m=+23.747698023" Jun 13 05:24:48.767968 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.767944 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wqsgn" podStartSLOduration=3.345455103 podStartE2EDuration="23.767939176s" totalImagesPullingTime="20.422484073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:48.767754837 +0000 UTC m=+23.747698720" watchObservedRunningTime="2026-06-13 05:24:48.767939176 +0000 UTC m=+23.747883069" Jun 13 05:24:48.781713 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.781678 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h4nhg" podStartSLOduration=3.381088602 podStartE2EDuration="23.781663517s" totalImagesPullingTime="20.400574915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:48.781249099 +0000 UTC m=+23.761192993" watchObservedRunningTime="2026-06-13 05:24:48.781663517 +0000 UTC m=+23.761607412" Jun 13 05:24:48.797696 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:48.797664 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xjvfv" podStartSLOduration=3.472821124 podStartE2EDuration="23.797653234s" totalImagesPullingTime="20.32483211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:48.797282274 +0000 UTC m=+23.777226170" watchObservedRunningTime="2026-06-13 05:24:48.797653234 +0000 UTC m=+23.777597126" Jun 13 05:24:49.478933 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:49.478903 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:49.479191 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:49.479018 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:49.695151 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:49.694934 2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 13 05:24:49.744914 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:49.744850 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" event={"ID":"f94d4248-88b3-4ecd-bb00-94ce56032e70","Type":"ContainerStarted","Data":"904174cd5d26500c3fe5eab15de3bb9358e637ff4799f2d404d999be5fb825f9"} Jun 13 05:24:49.746637 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:49.746615 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" event={"ID":"018a72ef60f374f9167b03569e934049","Type":"ContainerStarted","Data":"4e979197e9f53bdcb339c88879d622c5e840b2df3bbee7523f44696e81dc9c8e"} Jun 13 05:24:49.761467 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:49.761430 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-93.ec2.internal" podStartSLOduration=23.761414767 podStartE2EDuration="23.761414767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:49.760967398 +0000 UTC m=+24.740911290" watchObservedRunningTime="2026-06-13 05:24:49.761414767 +0000 UTC m=+24.741358659" Jun 13 05:24:50.479486 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:50.479453 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:50.479794 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:50.479496 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:50.479794 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:50.479588 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:50.479794 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:50.479644 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:50.487127 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:50.487015 2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-13T05:24:49.694955598Z","UUID":"c64cfab9-bd0e-486d-a205-d601689ac045","Handler":null,"Name":"","Endpoint":""} Jun 13 05:24:50.489038 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:50.489014 2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 13 05:24:50.489182 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:50.489059 2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 13 05:24:50.753193 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:50.753129 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:24:50.753657 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:50.753622 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"2393509ff322b2bb17b1cbeed36344f02c5a3fb60c87c59bcd6548bb72caebf4"} Jun 13 05:24:51.479354 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:51.479323 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:51.479517 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:51.479423 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:51.762462 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:51.762380 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" event={"ID":"f94d4248-88b3-4ecd-bb00-94ce56032e70","Type":"ContainerStarted","Data":"1f9ec2b96c4bb0fd71de6d8d918911a8d846e28221ca0fdbcf5a3de6b93c1f16"} Jun 13 05:24:51.773098 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:51.773054 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:51.773605 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:51.773580 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:51.780958 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:51.780919 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gkgzm" podStartSLOduration=4.047207765 podStartE2EDuration="26.780907715s" totalImagesPullingTime="22.73369995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:51.780422617 +0000 UTC m=+26.760366511" watchObservedRunningTime="2026-06-13 05:24:51.780907715 +0000 UTC m=+26.760851607" Jun 13 05:24:52.479228 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:52.479189 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:52.479411 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:52.479193 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:52.479411 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:52.479309 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:52.479532 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:52.479411 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:52.764984 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:52.764954 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:52.765588 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:52.765568 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h4nhg" Jun 13 05:24:53.479265 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.479098 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:53.479385 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:53.479341 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:53.768224 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.768168 2584 generic.go:356] "Generic (PLEG): container finished" podID="de0008d7-97be-4936-94a9-0f811a899ad8" containerID="388aec149ecf94e8cabbcaaaf01952549b7480cbf81b5d49edfa271f22a2a442" exitCode=0 Jun 13 05:24:53.769018 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.768245 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" event={"ID":"de0008d7-97be-4936-94a9-0f811a899ad8","Type":"ContainerDied","Data":"388aec149ecf94e8cabbcaaaf01952549b7480cbf81b5d49edfa271f22a2a442"} Jun 13 05:24:53.772038 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.772021 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:24:53.772488 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.772449 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"913085935d39edae35b766a47d6442b551929310851affcf3d28d9e716a0cb21"} Jun 13 05:24:53.772762 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.772737 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:53.772884 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.772803 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:53.772884 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.772850 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:53.773000 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.772898 2584 scope.go:117] "RemoveContainer" containerID="e18a6082546bb9c2ff204574d8801db3d60ce24b8c698a0fe459538357dfb3d7" Jun 13 05:24:53.788996 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.788973 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:53.789171 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:53.789155 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:24:54.478948 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:54.478766 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:54.479224 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:54.478819 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:54.479224 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:54.479043 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:54.479224 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:54.479111 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:54.778332 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:54.778312 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:24:54.778840 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:54.778711 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" event={"ID":"2d374972-c83c-4e5c-8f76-df2bcf171205","Type":"ContainerStarted","Data":"66af0a6783117eb1440c1b7401bd752e7cc68ee4e90620d4786edd8c5431296c"} Jun 13 05:24:54.804801 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:54.804761 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" podStartSLOduration=8.912552038 podStartE2EDuration="29.804747214s" totalImagesPullingTime="20.892195176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:24:54.804310738 +0000 UTC m=+29.784254630" watchObservedRunningTime="2026-06-13 05:24:54.804747214 +0000 UTC m=+29.784691115" Jun 13 05:24:55.081917 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:55.081858 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-trmhx"] Jun 13 05:24:55.082032 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:55.081975 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:55.082117 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:55.082067 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:55.084751 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:55.084725 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhw9l"] Jun 13 05:24:55.084856 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:55.084842 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:55.084982 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:55.084958 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:55.085220 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:55.085199 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8cncf"] Jun 13 05:24:55.085294 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:55.085277 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:55.085363 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:55.085343 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:55.783498 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:55.783460 2584 generic.go:356] "Generic (PLEG): container finished" podID="de0008d7-97be-4936-94a9-0f811a899ad8" containerID="dd65194d6973890d6f520e75654f7d587e09a53a3853c1bf4c81217208aa9c3c" exitCode=0 Jun 13 05:24:55.784003 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:55.783546 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" event={"ID":"de0008d7-97be-4936-94a9-0f811a899ad8","Type":"ContainerDied","Data":"dd65194d6973890d6f520e75654f7d587e09a53a3853c1bf4c81217208aa9c3c"} Jun 13 05:24:56.479314 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:56.479287 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:56.479584 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:56.479297 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:56.479719 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:56.479597 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:24:56.479719 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:56.479359 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:56.479719 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:56.479675 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:56.479860 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:56.479738 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:57.791611 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:57.791568 2584 generic.go:356] "Generic (PLEG): container finished" podID="de0008d7-97be-4936-94a9-0f811a899ad8" containerID="1e74ff70ad719f4e99e30bd1373d74f45f5c5ea03205f072e5f5e3791dde883c" exitCode=0 Jun 13 05:24:57.792098 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:57.791623 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" event={"ID":"de0008d7-97be-4936-94a9-0f811a899ad8","Type":"ContainerDied","Data":"1e74ff70ad719f4e99e30bd1373d74f45f5c5ea03205f072e5f5e3791dde883c"} Jun 13 05:24:58.281594 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:58.281561 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:58.281760 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:58.281608 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:58.281760 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.281715 2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:58.281760 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.281738 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:58.281904 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.281785 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret podName:d42a9998-9674-4087-b5f5-607ee9a3cf5b nodeName:}" failed. No retries permitted until 2026-06-13 05:25:30.281767453 +0000 UTC m=+65.261711368 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret") pod "global-pull-secret-syncer-nhw9l" (UID: "d42a9998-9674-4087-b5f5-607ee9a3cf5b") : object "kube-system"/"original-pull-secret" not registered Jun 13 05:24:58.281904 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.281802 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:30.281795019 +0000 UTC m=+65.261738889 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 13 05:24:58.382900 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:58.382867 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:58.383035 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.383008 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 13 05:24:58.383035 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.383029 2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 13 05:24:58.383144 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.383041 2584 projected.go:196] Error preparing data for projected volume kube-api-access-crql9 for pod openshift-network-diagnostics/network-check-target-8cncf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:58.383144 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.383117 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9 podName:118b5b23-7d4e-45cf-8e8e-e8f616ca40ed nodeName:}" failed. No retries permitted until 2026-06-13 05:25:30.383100339 +0000 UTC m=+65.363044226 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-crql9" (UniqueName: "kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9") pod "network-check-target-8cncf" (UID: "118b5b23-7d4e-45cf-8e8e-e8f616ca40ed") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 13 05:24:58.478759 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:58.478731 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:24:58.478919 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:58.478769 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:24:58.478919 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.478850 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:24:58.479168 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:24:58.479152 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:24:58.479276 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.479255 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:24:58.479370 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:24:58.479350 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:25:00.479666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:00.479477 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:25:00.480157 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:00.479511 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:25:00.480157 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:00.479758 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8cncf" podUID="118b5b23-7d4e-45cf-8e8e-e8f616ca40ed" Jun 13 05:25:00.480157 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:00.479866 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nhw9l" podUID="d42a9998-9674-4087-b5f5-607ee9a3cf5b" Jun 13 05:25:00.480157 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:00.479540 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:25:00.480157 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:00.479985 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:25:01.256905 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.256873 2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-93.ec2.internal" event="NodeReady" Jun 13 05:25:01.257050 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.256995 2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 13 05:25:01.288780 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.288706 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b4d6cd465-vk697"] Jun 13 05:25:01.291427 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.291405 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.294221 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.294201 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 13 05:25:01.294345 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.294205 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 13 05:25:01.294416 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.294369 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tdxg2\"" Jun 13 05:25:01.294416 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.294411 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 13 05:25:01.299187 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.299166 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 13 05:25:01.302063 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.302044 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7dl2d"] Jun 13 05:25:01.303693 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.303677 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7dl2d" Jun 13 05:25:01.306564 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.305752 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w54d4"] Jun 13 05:25:01.306564 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.306502 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 13 05:25:01.306714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.306698 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hg2sl\"" Jun 13 05:25:01.306799 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.306773 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 13 05:25:01.306940 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.306909 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 13 05:25:01.307792 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.307746 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b4d6cd465-vk697"] Jun 13 05:25:01.307884 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.307853 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.310397 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.310380 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 13 05:25:01.310582 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.310569 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-24sgs\"" Jun 13 05:25:01.310730 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.310718 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 13 05:25:01.313439 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.313132 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7dl2d"] Jun 13 05:25:01.319048 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.319026 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w54d4"] Jun 13 05:25:01.407019 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.406982 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-image-registry-private-configuration\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.407019 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407024 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fa0a34c-57db-4147-acca-f63c1ccdae56-ca-trust-extracted\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.407277 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407043 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84x59\" (UniqueName: \"kubernetes.io/projected/c8014faf-8210-422e-afed-a4af9eb97e04-kube-api-access-84x59\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.407277 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407091 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-trusted-ca\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.407277 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407173 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-certificates\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.407277 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407205 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v62cj\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-kube-api-access-v62cj\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.407277 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407255 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-bound-sa-token\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.407502 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407326 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b76dae1-0c22-4a9d-a7ef-3868336a2e2a-cert\") pod \"ingress-canary-7dl2d\" (UID: \"6b76dae1-0c22-4a9d-a7ef-3868336a2e2a\") " pod="openshift-ingress-canary/ingress-canary-7dl2d" Jun 13 05:25:01.407502 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407356 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8014faf-8210-422e-afed-a4af9eb97e04-config-volume\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.407502 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407377 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbwbx\" (UniqueName: \"kubernetes.io/projected/6b76dae1-0c22-4a9d-a7ef-3868336a2e2a-kube-api-access-xbwbx\") pod \"ingress-canary-7dl2d\" (UID: \"6b76dae1-0c22-4a9d-a7ef-3868336a2e2a\") " pod="openshift-ingress-canary/ingress-canary-7dl2d" Jun 13 05:25:01.407502 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407402 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8014faf-8210-422e-afed-a4af9eb97e04-tmp-dir\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.407502 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407462 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.407502 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407497 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-installation-pull-secrets\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.407731 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.407518 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508142 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508105 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-image-registry-private-configuration\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508142 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508146 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fa0a34c-57db-4147-acca-f63c1ccdae56-ca-trust-extracted\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508166 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84x59\" (UniqueName: \"kubernetes.io/projected/c8014faf-8210-422e-afed-a4af9eb97e04-kube-api-access-84x59\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508242 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-trusted-ca\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508306 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-certificates\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508333 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v62cj\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-kube-api-access-v62cj\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508380 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-bound-sa-token\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508417 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b76dae1-0c22-4a9d-a7ef-3868336a2e2a-cert\") pod \"ingress-canary-7dl2d\" (UID: \"6b76dae1-0c22-4a9d-a7ef-3868336a2e2a\") " pod="openshift-ingress-canary/ingress-canary-7dl2d" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508456 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8014faf-8210-422e-afed-a4af9eb97e04-config-volume\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508479 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbwbx\" (UniqueName: \"kubernetes.io/projected/6b76dae1-0c22-4a9d-a7ef-3868336a2e2a-kube-api-access-xbwbx\") pod \"ingress-canary-7dl2d\" (UID: \"6b76dae1-0c22-4a9d-a7ef-3868336a2e2a\") " pod="openshift-ingress-canary/ingress-canary-7dl2d" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508508 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8014faf-8210-422e-afed-a4af9eb97e04-tmp-dir\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508542 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508569 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-installation-pull-secrets\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508578 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fa0a34c-57db-4147-acca-f63c1ccdae56-ca-trust-extracted\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.508631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508593 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.509271 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:01.508771 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:01.509271 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:01.508843 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:02.008825978 +0000 UTC m=+36.988769865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:25:01.509271 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508914 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8014faf-8210-422e-afed-a4af9eb97e04-tmp-dir\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.509271 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.508920 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-certificates\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.509271 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:01.508941 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:25:01.509271 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:01.508961 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:25:01.509271 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:01.509027 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:02.009008574 +0000 UTC m=+36.988952459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:25:01.509271 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.509261 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-trusted-ca\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.509585 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.509362 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c8014faf-8210-422e-afed-a4af9eb97e04-config-volume\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.513031 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.513011 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6b76dae1-0c22-4a9d-a7ef-3868336a2e2a-cert\") pod \"ingress-canary-7dl2d\" (UID: \"6b76dae1-0c22-4a9d-a7ef-3868336a2e2a\") " pod="openshift-ingress-canary/ingress-canary-7dl2d" Jun 13 05:25:01.513169 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.513053 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-installation-pull-secrets\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.514503 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.514479 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-image-registry-private-configuration\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.519009 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.518984 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84x59\" (UniqueName: \"kubernetes.io/projected/c8014faf-8210-422e-afed-a4af9eb97e04-kube-api-access-84x59\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:01.519409 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.519384 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-bound-sa-token\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.519489 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.519434 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v62cj\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-kube-api-access-v62cj\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:01.519837 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.519800 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbwbx\" (UniqueName: \"kubernetes.io/projected/6b76dae1-0c22-4a9d-a7ef-3868336a2e2a-kube-api-access-xbwbx\") pod \"ingress-canary-7dl2d\" (UID: \"6b76dae1-0c22-4a9d-a7ef-3868336a2e2a\") " pod="openshift-ingress-canary/ingress-canary-7dl2d" Jun 13 05:25:01.616947 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:01.616874 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7dl2d" Jun 13 05:25:02.012446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.012366 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:02.012446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.012419 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:02.012642 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:02.012518 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:02.012642 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:02.012571 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:25:02.012642 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:02.012591 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:25:02.012642 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:02.012597 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:03.012580007 +0000 UTC m=+37.992523882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:25:02.012642 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:02.012639 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:03.012626548 +0000 UTC m=+37.992570419 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:25:02.318868 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.318716 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7dl2d"] Jun 13 05:25:02.321972 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:25:02.321941 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b76dae1_0c22_4a9d_a7ef_3868336a2e2a.slice/crio-a1792a6b2251a99cdfabe1ea295f1faf097d266ff6a7dcc52f8922532fdc2a70 WatchSource:0}: Error finding container a1792a6b2251a99cdfabe1ea295f1faf097d266ff6a7dcc52f8922532fdc2a70: Status 404 returned error can't find the container with id a1792a6b2251a99cdfabe1ea295f1faf097d266ff6a7dcc52f8922532fdc2a70 Jun 13 05:25:02.478977 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.478954 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:25:02.479098 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.478955 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:25:02.479154 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.478954 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:25:02.481761 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.481741 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 05:25:02.481863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.481763 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 05:25:02.481863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.481784 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mn5hn\"" Jun 13 05:25:02.481863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.481766 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6p7zj\"" Jun 13 05:25:02.481863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.481845 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 05:25:02.481863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.481764 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 05:25:02.806516 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.806480 2584 generic.go:356] "Generic (PLEG): container finished" podID="de0008d7-97be-4936-94a9-0f811a899ad8" containerID="476018c2965716f7a46899d56b9076b632d7c455c6a701df51470d7fa04caf03" exitCode=0 Jun 13 05:25:02.807180 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.806571 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" event={"ID":"de0008d7-97be-4936-94a9-0f811a899ad8","Type":"ContainerDied","Data":"476018c2965716f7a46899d56b9076b632d7c455c6a701df51470d7fa04caf03"} Jun 13 05:25:02.807969 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:02.807939 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7dl2d" event={"ID":"6b76dae1-0c22-4a9d-a7ef-3868336a2e2a","Type":"ContainerStarted","Data":"a1792a6b2251a99cdfabe1ea295f1faf097d266ff6a7dcc52f8922532fdc2a70"} Jun 13 05:25:03.021667 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:03.021643 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:03.021795 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:03.021679 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:03.021850 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:03.021813 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:03.021905 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:03.021815 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:25:03.021905 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:03.021902 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:25:03.021997 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:03.021884 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:05.021868064 +0000 UTC m=+40.001811938 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:25:03.021997 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:03.021965 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:05.021947975 +0000 UTC m=+40.001891851 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:25:03.818104 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:03.814911 2584 generic.go:356] "Generic (PLEG): container finished" podID="de0008d7-97be-4936-94a9-0f811a899ad8" containerID="b257d453da9ec5296f96eb350062f412d6b0525b0107fb2824999f4df16465b3" exitCode=0 Jun 13 05:25:03.818104 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:03.814962 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" event={"ID":"de0008d7-97be-4936-94a9-0f811a899ad8","Type":"ContainerDied","Data":"b257d453da9ec5296f96eb350062f412d6b0525b0107fb2824999f4df16465b3"} Jun 13 05:25:04.820366 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:04.820217 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" event={"ID":"de0008d7-97be-4936-94a9-0f811a899ad8","Type":"ContainerStarted","Data":"712602f1b820191a7247467965ff7730c2b03d155953301867217f7c0e0f0234"} Jun 13 05:25:04.824343 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:04.824317 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:04.843128 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:04.843065 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wvzzk" podStartSLOduration=8.238571347 podStartE2EDuration="39.84305196s" totalImagesPullingTime="31.604480613s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:04.840848399 +0000 UTC m=+39.820792305" watchObservedRunningTime="2026-06-13 05:25:04.84305196 +0000 UTC m=+39.822995853" Jun 13 05:25:04.899878 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:04.899839 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:04.997306 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:04.997233 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:05.037239 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:05.037208 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:05.037405 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:05.037336 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:05.037405 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:05.037376 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:25:05.037405 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:05.037397 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:25:05.037565 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:05.037462 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:09.037444776 +0000 UTC m=+44.017388669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:25:05.037565 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:05.037472 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:05.037565 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:05.037522 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:09.037507844 +0000 UTC m=+44.017451731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:25:05.098372 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:05.098339 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:05.156476 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:05.156450 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:05.241649 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:05.241619 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:05.823667 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:05.823617 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7dl2d" event={"ID":"6b76dae1-0c22-4a9d-a7ef-3868336a2e2a","Type":"ContainerStarted","Data":"ff72c8d19ac43941003bbf64431f038ae2e4a461834f059e0bc2a2b842add03c"} Jun 13 05:25:05.840411 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:05.840366 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7dl2d" podStartSLOduration=2.437252673 podStartE2EDuration="4.840353213s" totalImagesPullingTime="2.40310054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:05.840046692 +0000 UTC m=+40.819990586" watchObservedRunningTime="2026-06-13 05:25:05.840353213 +0000 UTC m=+40.820297106" Jun 13 05:25:07.063779 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:07.063744 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:07.164871 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:07.164843 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:09.063961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:09.063922 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:09.063961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:09.063962 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:09.064406 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:09.064098 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:09.064406 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:09.064109 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:25:09.064406 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:09.064122 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:25:09.064406 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:09.064165 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:17.064145505 +0000 UTC m=+52.044089375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:25:09.064406 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:09.064181 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:17.064174703 +0000 UTC m=+52.044118573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:25:13.105260 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:13.105223 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:13.156285 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:13.156249 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:13.925110 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:13.925061 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:15.907145 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:15.907107 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:15.956269 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:15.956237 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:17.118348 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:17.118312 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:17.118790 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:17.118395 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:17.118790 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:17.118484 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:17.118790 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:17.118489 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:25:17.118790 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:17.118511 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:25:17.118790 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:17.118543 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:33.118530087 +0000 UTC m=+68.098473958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:25:17.118790 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:17.118571 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:25:33.118554294 +0000 UTC m=+68.098498165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:25:17.325437 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:17.325404 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:17.374005 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:17.373952 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:25.794456 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:25.794414 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8jcnk" Jun 13 05:25:25.941057 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:25.941024 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:25.990160 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:25.990125 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:30.303699 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.303655 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:25:30.304311 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.303743 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:25:30.306284 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.306262 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 13 05:25:30.306348 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.306263 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 13 05:25:30.314326 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:30.314306 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 05:25:30.314392 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:30.314372 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:26:34.314354144 +0000 UTC m=+129.294298016 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : secret "metrics-daemon-secret" not found Jun 13 05:25:30.319023 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.318996 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d42a9998-9674-4087-b5f5-607ee9a3cf5b-original-pull-secret\") pod \"global-pull-secret-syncer-nhw9l\" (UID: \"d42a9998-9674-4087-b5f5-607ee9a3cf5b\") " pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:25:30.388190 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.388164 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nhw9l" Jun 13 05:25:30.404816 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.404781 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:25:30.407401 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.407378 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 13 05:25:30.417276 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.417253 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 13 05:25:30.427992 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.427968 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crql9\" (UniqueName: \"kubernetes.io/projected/118b5b23-7d4e-45cf-8e8e-e8f616ca40ed-kube-api-access-crql9\") pod \"network-check-target-8cncf\" (UID: \"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed\") " pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:25:30.512937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.512907 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nhw9l"] Jun 13 05:25:30.515635 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:25:30.515614 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42a9998_9674_4087_b5f5_607ee9a3cf5b.slice/crio-0234e9e877333cf9ff9d6ac929b5af64bbfefefb5041387813692adbfed3562b WatchSource:0}: Error finding container 0234e9e877333cf9ff9d6ac929b5af64bbfefefb5041387813692adbfed3562b: Status 404 returned error can't find the container with id 0234e9e877333cf9ff9d6ac929b5af64bbfefefb5041387813692adbfed3562b Jun 13 05:25:30.696710 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.696651 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6p7zj\"" Jun 13 05:25:30.705101 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.705067 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:25:30.826676 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.826651 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8cncf"] Jun 13 05:25:30.829746 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:25:30.829723 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod118b5b23_7d4e_45cf_8e8e_e8f616ca40ed.slice/crio-538240db4a2a0636870692045084078c4c18089f49f14016c535f2673f5fbdf1 WatchSource:0}: Error finding container 538240db4a2a0636870692045084078c4c18089f49f14016c535f2673f5fbdf1: Status 404 returned error can't find the container with id 538240db4a2a0636870692045084078c4c18089f49f14016c535f2673f5fbdf1 Jun 13 05:25:30.880323 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.880295 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhw9l" event={"ID":"d42a9998-9674-4087-b5f5-607ee9a3cf5b","Type":"ContainerStarted","Data":"0234e9e877333cf9ff9d6ac929b5af64bbfefefb5041387813692adbfed3562b"} Jun 13 05:25:30.881413 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:30.881389 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8cncf" event={"ID":"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed","Type":"ContainerStarted","Data":"538240db4a2a0636870692045084078c4c18089f49f14016c535f2673f5fbdf1"} Jun 13 05:25:33.123957 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:33.123802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:25:33.123957 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:33.123861 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:25:33.124453 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:33.123971 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:25:33.124453 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:33.123991 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:25:33.124453 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:33.124009 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:25:33.124453 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:33.124037 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:26:05.124022057 +0000 UTC m=+100.103965928 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:25:33.124453 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:25:33.124057 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:26:05.12404292 +0000 UTC m=+100.103986794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:25:34.081356 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:34.081280 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:34.133215 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:34.133181 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:34.893258 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:34.893174 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8cncf" event={"ID":"118b5b23-7d4e-45cf-8e8e-e8f616ca40ed","Type":"ContainerStarted","Data":"c3191782984411c593e1c620719eece84890607f712d418c060df2039feac8d8"} Jun 13 05:25:34.893406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:34.893319 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:25:34.911442 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:34.911396 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8cncf" podStartSLOduration=66.203804583 podStartE2EDuration="1m9.911382416s" totalImagesPullingTime="3.707577833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:24:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:34.91068384 +0000 UTC m=+69.890627734" watchObservedRunningTime="2026-06-13 05:25:34.911382416 +0000 UTC m=+69.891326352" Jun 13 05:25:36.900545 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:36.900506 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nhw9l" event={"ID":"d42a9998-9674-4087-b5f5-607ee9a3cf5b","Type":"ContainerStarted","Data":"857fc58e22dffe45c14745638e033c9b9adfc3e56e7903e02dd460cc599750f9"} Jun 13 05:25:36.915312 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:36.915255 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nhw9l" podStartSLOduration=65.206091333 podStartE2EDuration="1m10.915239012s" totalImagesPullingTime="5.709147679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:25:36.914644613 +0000 UTC m=+71.894588524" watchObservedRunningTime="2026-06-13 05:25:36.915239012 +0000 UTC m=+71.895182902" Jun 13 05:25:39.859099 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:39.858992 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:39.959714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:39.959686 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:40.006206 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:40.006183 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:41.451697 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:41.451658 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:25:41.552086 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:25:41.552039 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:26:05.146669 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:26:05.146630 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:26:05.146669 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:26:05.146672 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:26:05.147168 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:26:05.146770 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:26:05.147168 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:26:05.146780 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:26:05.147168 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:26:05.146779 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:26:05.147168 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:26:05.146838 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:27:09.146825316 +0000 UTC m=+164.126769187 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:26:05.147168 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:26:05.146850 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:27:09.14684457 +0000 UTC m=+164.126788441 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:26:05.898592 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:26:05.898556 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8cncf" Jun 13 05:26:34.344186 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:26:34.344127 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:26:34.344668 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:26:34.344259 2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 13 05:26:34.344668 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:26:34.344321 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs podName:cd190152-b46d-4522-ac9d-cc8f64fae7d4 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:36.34430776 +0000 UTC m=+251.324251631 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs") pod "network-metrics-daemon-trmhx" (UID: "cd190152-b46d-4522-ac9d-cc8f64fae7d4") : secret "metrics-daemon-secret" not found Jun 13 05:27:04.302850 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:04.302802 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" podUID="3fa0a34c-57db-4147-acca-f63c1ccdae56" Jun 13 05:27:04.323991 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:04.323951 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w54d4" podUID="c8014faf-8210-422e-afed-a4af9eb97e04" Jun 13 05:27:05.106964 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:05.106933 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:27:05.107107 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:05.106968 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w54d4" Jun 13 05:27:05.498093 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:05.498009 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-trmhx" podUID="cd190152-b46d-4522-ac9d-cc8f64fae7d4" Jun 13 05:27:09.170593 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:09.170549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:27:09.170593 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:09.170596 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:27:09.171019 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:09.170690 2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 13 05:27:09.171019 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:09.170704 2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 13 05:27:09.171019 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:09.170714 2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5b4d6cd465-vk697: secret "image-registry-tls" not found Jun 13 05:27:09.171019 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:09.170758 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls podName:c8014faf-8210-422e-afed-a4af9eb97e04 nodeName:}" failed. No retries permitted until 2026-06-13 05:29:11.170743901 +0000 UTC m=+286.150687772 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls") pod "dns-default-w54d4" (UID: "c8014faf-8210-422e-afed-a4af9eb97e04") : secret "dns-default-metrics-tls" not found Jun 13 05:27:09.171019 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:09.170773 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls podName:3fa0a34c-57db-4147-acca-f63c1ccdae56 nodeName:}" failed. No retries permitted until 2026-06-13 05:29:11.170766065 +0000 UTC m=+286.150709937 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls") pod "image-registry-5b4d6cd465-vk697" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56") : secret "image-registry-tls" not found Jun 13 05:27:18.479156 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:18.479060 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:27:30.741640 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:30.741588 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:52.938429 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.938394 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd"] Jun 13 05:27:52.940094 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.940061 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:52.941991 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.941964 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn"] Jun 13 05:27:52.942742 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.942720 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 13 05:27:52.942837 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.942752 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 13 05:27:52.943413 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.943394 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 13 05:27:52.943467 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.943413 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nt2ht\"" Jun 13 05:27:52.943695 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.943681 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-kx8lz"] Jun 13 05:27:52.943796 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.943782 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:52.945816 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.945797 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 13 05:27:52.945981 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.945947 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 13 05:27:52.946158 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.946138 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:52.946252 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.946181 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 13 05:27:52.946252 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.946186 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ch5mm\"" Jun 13 05:27:52.946488 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.946465 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 13 05:27:52.948624 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.948549 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 13 05:27:52.948624 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.948586 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 13 05:27:52.948762 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.948706 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 13 05:27:52.948815 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.948799 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 13 05:27:52.948869 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.948829 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-h6z78\"" Jun 13 05:27:52.954010 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.953989 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd"] Jun 13 05:27:52.954585 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.954567 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 13 05:27:52.956193 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.956173 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn"] Jun 13 05:27:52.970423 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:52.970401 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-kx8lz"] Jun 13 05:27:53.033694 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.033658 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg"] Jun 13 05:27:53.035781 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.035751 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg" Jun 13 05:27:53.036996 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.036976 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-c5djt"] Jun 13 05:27:53.038115 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.038100 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-k2mrm\"" Jun 13 05:27:53.038714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.038700 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:53.041042 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.041027 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hdn5s\"" Jun 13 05:27:53.041271 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.041252 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 13 05:27:53.041541 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.041522 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 13 05:27:53.045404 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.045378 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg"] Jun 13 05:27:53.054637 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.054615 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-c5djt"] Jun 13 05:27:53.059848 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.059829 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94b82225-6fde-42c6-9517-bcc799724be2-tmp\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.059947 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.059860 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc53e88-5f95-4d02-ad63-033e02adc4b8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.059947 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.059877 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b82225-6fde-42c6-9517-bcc799724be2-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.059947 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.059892 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94b82225-6fde-42c6-9517-bcc799724be2-serving-cert\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.059947 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.059927 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r6qs\" (UniqueName: \"kubernetes.io/projected/94b82225-6fde-42c6-9517-bcc799724be2-kube-api-access-6r6qs\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.060176 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.059985 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b82225-6fde-42c6-9517-bcc799724be2-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.060176 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.060040 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfp9\" (UniqueName: \"kubernetes.io/projected/1dc53e88-5f95-4d02-ad63-033e02adc4b8-kube-api-access-rdfp9\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.060176 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.060105 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:53.060176 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.060130 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dc53e88-5f95-4d02-ad63-033e02adc4b8-config\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.060297 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.060196 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm8b7\" (UniqueName: \"kubernetes.io/projected/38a74db6-625f-4222-b9a0-ecf027a7aefa-kube-api-access-bm8b7\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:53.060297 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.060220 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94b82225-6fde-42c6-9517-bcc799724be2-snapshots\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.133043 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.133007 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84"] Jun 13 05:27:53.134938 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.134923 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84" Jun 13 05:27:53.137518 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.137497 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pcj8p\"" Jun 13 05:27:53.137631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.137500 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 13 05:27:53.137631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.137529 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 13 05:27:53.142690 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.142668 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84"] Jun 13 05:27:53.160545 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160518 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b82225-6fde-42c6-9517-bcc799724be2-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.160707 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160556 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfp9\" (UniqueName: \"kubernetes.io/projected/1dc53e88-5f95-4d02-ad63-033e02adc4b8-kube-api-access-rdfp9\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.160707 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160583 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc53e88-5f95-4d02-ad63-033e02adc4b8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.160707 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160611 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm8b7\" (UniqueName: \"kubernetes.io/projected/38a74db6-625f-4222-b9a0-ecf027a7aefa-kube-api-access-bm8b7\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:53.160707 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160641 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bptj8\" (UniqueName: \"kubernetes.io/projected/4b102279-5557-4671-87a2-2d69058ed820-kube-api-access-bptj8\") pod \"network-check-source-6947749cfc-wm2dg\" (UID: \"4b102279-5557-4671-87a2-2d69058ed820\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg" Jun 13 05:27:53.160707 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160661 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b82225-6fde-42c6-9517-bcc799724be2-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.160707 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160681 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dc53e88-5f95-4d02-ad63-033e02adc4b8-config\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.160953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160713 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:53.161455 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.160829 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94b82225-6fde-42c6-9517-bcc799724be2-snapshots\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.161630 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.161505 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61f9d614-9416-47f4-97a8-605c1e86b71e-nginx-conf\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:53.161703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.161653 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:53.161761 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.161725 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r6qs\" (UniqueName: \"kubernetes.io/projected/94b82225-6fde-42c6-9517-bcc799724be2-kube-api-access-6r6qs\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.161822 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.161802 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94b82225-6fde-42c6-9517-bcc799724be2-tmp\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.165450 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.165429 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94b82225-6fde-42c6-9517-bcc799724be2-serving-cert\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.165570 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:53.161976 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 05:27:53.165570 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.162027 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/94b82225-6fde-42c6-9517-bcc799724be2-snapshots\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.165570 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.162307 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b82225-6fde-42c6-9517-bcc799724be2-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.165570 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.162402 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94b82225-6fde-42c6-9517-bcc799724be2-tmp\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.165570 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:53.165531 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls podName:38a74db6-625f-4222-b9a0-ecf027a7aefa nodeName:}" failed. No retries permitted until 2026-06-13 05:27:53.665511091 +0000 UTC m=+208.645454977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kf5hd" (UID: "38a74db6-625f-4222-b9a0-ecf027a7aefa") : secret "samples-operator-tls" not found Jun 13 05:27:53.165570 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.163758 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1dc53e88-5f95-4d02-ad63-033e02adc4b8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.165570 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.162043 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1dc53e88-5f95-4d02-ad63-033e02adc4b8-config\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.165921 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.165617 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94b82225-6fde-42c6-9517-bcc799724be2-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.167983 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.167961 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94b82225-6fde-42c6-9517-bcc799724be2-serving-cert\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.169284 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.169264 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfp9\" (UniqueName: \"kubernetes.io/projected/1dc53e88-5f95-4d02-ad63-033e02adc4b8-kube-api-access-rdfp9\") pod \"service-ca-operator-7ccbfd59dc-xqqgn\" (UID: \"1dc53e88-5f95-4d02-ad63-033e02adc4b8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.169494 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.169472 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm8b7\" (UniqueName: \"kubernetes.io/projected/38a74db6-625f-4222-b9a0-ecf027a7aefa-kube-api-access-bm8b7\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:53.170057 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.170037 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r6qs\" (UniqueName: \"kubernetes.io/projected/94b82225-6fde-42c6-9517-bcc799724be2-kube-api-access-6r6qs\") pod \"insights-operator-5bbd86d6bd-kx8lz\" (UID: \"94b82225-6fde-42c6-9517-bcc799724be2\") " pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.176005 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.175984 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:53.259764 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.259687 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" Jun 13 05:27:53.264991 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.264972 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" Jun 13 05:27:53.266284 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.266259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bptj8\" (UniqueName: \"kubernetes.io/projected/4b102279-5557-4671-87a2-2d69058ed820-kube-api-access-bptj8\") pod \"network-check-source-6947749cfc-wm2dg\" (UID: \"4b102279-5557-4671-87a2-2d69058ed820\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg" Jun 13 05:27:53.266385 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.266324 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:53.266385 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.266351 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61f9d614-9416-47f4-97a8-605c1e86b71e-nginx-conf\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:53.266491 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.266441 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4qpn\" (UniqueName: \"kubernetes.io/projected/5333a442-870d-4eb7-934d-0623bb7ce7f1-kube-api-access-g4qpn\") pod \"volume-data-source-validator-bd4ccd799-8qb84\" (UID: \"5333a442-870d-4eb7-934d-0623bb7ce7f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84" Jun 13 05:27:53.266491 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:53.266464 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 05:27:53.266669 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:53.266566 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert podName:61f9d614-9416-47f4-97a8-605c1e86b71e nodeName:}" failed. No retries permitted until 2026-06-13 05:27:53.766545797 +0000 UTC m=+208.746489669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-c5djt" (UID: "61f9d614-9416-47f4-97a8-605c1e86b71e") : secret "networking-console-plugin-cert" not found Jun 13 05:27:53.267261 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.267236 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61f9d614-9416-47f4-97a8-605c1e86b71e-nginx-conf\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:53.274573 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.274549 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bptj8\" (UniqueName: \"kubernetes.io/projected/4b102279-5557-4671-87a2-2d69058ed820-kube-api-access-bptj8\") pod \"network-check-source-6947749cfc-wm2dg\" (UID: \"4b102279-5557-4671-87a2-2d69058ed820\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg" Jun 13 05:27:53.346405 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.346364 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg" Jun 13 05:27:53.367692 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.367653 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4qpn\" (UniqueName: \"kubernetes.io/projected/5333a442-870d-4eb7-934d-0623bb7ce7f1-kube-api-access-g4qpn\") pod \"volume-data-source-validator-bd4ccd799-8qb84\" (UID: \"5333a442-870d-4eb7-934d-0623bb7ce7f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84" Jun 13 05:27:53.376482 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.376452 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4qpn\" (UniqueName: \"kubernetes.io/projected/5333a442-870d-4eb7-934d-0623bb7ce7f1-kube-api-access-g4qpn\") pod \"volume-data-source-validator-bd4ccd799-8qb84\" (UID: \"5333a442-870d-4eb7-934d-0623bb7ce7f1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84" Jun 13 05:27:53.393768 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.393670 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn"] Jun 13 05:27:53.397005 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:27:53.396965 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc53e88_5f95_4d02_ad63_033e02adc4b8.slice/crio-a5a74609365116079e5dbcd319f09744866259d5e3de2e7dd70db5d5b9d13bc6 WatchSource:0}: Error finding container a5a74609365116079e5dbcd319f09744866259d5e3de2e7dd70db5d5b9d13bc6: Status 404 returned error can't find the container with id a5a74609365116079e5dbcd319f09744866259d5e3de2e7dd70db5d5b9d13bc6 Jun 13 05:27:53.411160 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.411106 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-kx8lz"] Jun 13 05:27:53.415166 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:27:53.415142 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b82225_6fde_42c6_9517_bcc799724be2.slice/crio-c1a7163b35e1f892ce117aa036ed63e004f496e4759f5c8089df524267024cee WatchSource:0}: Error finding container c1a7163b35e1f892ce117aa036ed63e004f496e4759f5c8089df524267024cee: Status 404 returned error can't find the container with id c1a7163b35e1f892ce117aa036ed63e004f496e4759f5c8089df524267024cee Jun 13 05:27:53.443361 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.443328 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84" Jun 13 05:27:53.476544 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.476510 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg"] Jun 13 05:27:53.479572 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:27:53.479541 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b102279_5557_4671_87a2_2d69058ed820.slice/crio-d7914b7f7eaf9b04235088ee6dad7276719363463e446551d98e661587e3943d WatchSource:0}: Error finding container d7914b7f7eaf9b04235088ee6dad7276719363463e446551d98e661587e3943d: Status 404 returned error can't find the container with id d7914b7f7eaf9b04235088ee6dad7276719363463e446551d98e661587e3943d Jun 13 05:27:53.568583 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.568544 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84"] Jun 13 05:27:53.571922 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:27:53.571898 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5333a442_870d_4eb7_934d_0623bb7ce7f1.slice/crio-74585c15184136b5974b0794b774c8241589035da1bf4fbfcc75e49b3fd25004 WatchSource:0}: Error finding container 74585c15184136b5974b0794b774c8241589035da1bf4fbfcc75e49b3fd25004: Status 404 returned error can't find the container with id 74585c15184136b5974b0794b774c8241589035da1bf4fbfcc75e49b3fd25004 Jun 13 05:27:53.670127 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.670090 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:53.670305 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:53.670220 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 05:27:53.670305 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:53.670291 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls podName:38a74db6-625f-4222-b9a0-ecf027a7aefa nodeName:}" failed. No retries permitted until 2026-06-13 05:27:54.670273069 +0000 UTC m=+209.650216940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kf5hd" (UID: "38a74db6-625f-4222-b9a0-ecf027a7aefa") : secret "samples-operator-tls" not found Jun 13 05:27:53.770773 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:53.770679 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:53.770929 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:53.770830 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 05:27:53.770929 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:53.770895 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert podName:61f9d614-9416-47f4-97a8-605c1e86b71e nodeName:}" failed. No retries permitted until 2026-06-13 05:27:54.770878103 +0000 UTC m=+209.750821987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-c5djt" (UID: "61f9d614-9416-47f4-97a8-605c1e86b71e") : secret "networking-console-plugin-cert" not found Jun 13 05:27:54.220233 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:54.220136 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:54.230362 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:54.230329 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84" event={"ID":"5333a442-870d-4eb7-934d-0623bb7ce7f1","Type":"ContainerStarted","Data":"74585c15184136b5974b0794b774c8241589035da1bf4fbfcc75e49b3fd25004"} Jun 13 05:27:54.231776 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:54.231750 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" event={"ID":"94b82225-6fde-42c6-9517-bcc799724be2","Type":"ContainerStarted","Data":"c1a7163b35e1f892ce117aa036ed63e004f496e4759f5c8089df524267024cee"} Jun 13 05:27:54.234041 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:54.233375 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg" event={"ID":"4b102279-5557-4671-87a2-2d69058ed820","Type":"ContainerStarted","Data":"3c211f863d4fe4de7b0235adc4223f828283caf434420bc8e1a0a8c7561cb34f"} Jun 13 05:27:54.234041 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:54.233419 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg" event={"ID":"4b102279-5557-4671-87a2-2d69058ed820","Type":"ContainerStarted","Data":"d7914b7f7eaf9b04235088ee6dad7276719363463e446551d98e661587e3943d"} Jun 13 05:27:54.235658 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:54.235634 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" event={"ID":"1dc53e88-5f95-4d02-ad63-033e02adc4b8","Type":"ContainerStarted","Data":"a5a74609365116079e5dbcd319f09744866259d5e3de2e7dd70db5d5b9d13bc6"} Jun 13 05:27:54.680334 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:54.680268 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:54.680521 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:54.680435 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 05:27:54.680521 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:54.680516 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls podName:38a74db6-625f-4222-b9a0-ecf027a7aefa nodeName:}" failed. No retries permitted until 2026-06-13 05:27:56.680496053 +0000 UTC m=+211.660439939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kf5hd" (UID: "38a74db6-625f-4222-b9a0-ecf027a7aefa") : secret "samples-operator-tls" not found Jun 13 05:27:54.781737 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:54.781209 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:54.781737 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:54.781408 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 05:27:54.781737 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:54.781478 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert podName:61f9d614-9416-47f4-97a8-605c1e86b71e nodeName:}" failed. No retries permitted until 2026-06-13 05:27:56.78145937 +0000 UTC m=+211.761403246 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-c5djt" (UID: "61f9d614-9416-47f4-97a8-605c1e86b71e") : secret "networking-console-plugin-cert" not found Jun 13 05:27:55.241652 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:55.241557 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84" event={"ID":"5333a442-870d-4eb7-934d-0623bb7ce7f1","Type":"ContainerStarted","Data":"2e72dd941a270cb79632a4ddb59a06bbaa7fc5d7e57447dda3cb02b77d239995"} Jun 13 05:27:55.256826 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:55.256773 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-8qb84" podStartSLOduration=0.961635156 podStartE2EDuration="2.256752869s" totalImagesPullingTime="1.295117713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:27:55.255423876 +0000 UTC m=+210.235367770" watchObservedRunningTime="2026-06-13 05:27:55.256752869 +0000 UTC m=+210.236696763" Jun 13 05:27:55.257323 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:55.257285 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-wm2dg" podStartSLOduration=2.25727368 podStartE2EDuration="2.25727368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:27:54.249274449 +0000 UTC m=+209.229218343" watchObservedRunningTime="2026-06-13 05:27:55.25727368 +0000 UTC m=+210.237217574" Jun 13 05:27:55.334354 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:55.334319 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:55.435143 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:55.435112 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:56.246785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.246745 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" event={"ID":"94b82225-6fde-42c6-9517-bcc799724be2","Type":"ContainerStarted","Data":"ef51eb255195ef0ce6ba28cb14e0355c8e59e2023df86656ba36fea2a4841e07"} Jun 13 05:27:56.248244 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.248212 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" event={"ID":"1dc53e88-5f95-4d02-ad63-033e02adc4b8","Type":"ContainerStarted","Data":"405873e164197f3c247dde135b114279fa4f8fad36ce92514c3ec1dfc4e33fe3"} Jun 13 05:27:56.262215 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.262122 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" podStartSLOduration=1.66279048 podStartE2EDuration="4.262105496s" totalImagesPullingTime="2.599315016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:27:56.260705588 +0000 UTC m=+211.240649494" watchObservedRunningTime="2026-06-13 05:27:56.262105496 +0000 UTC m=+211.242049391" Jun 13 05:27:56.274650 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.274600 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" podStartSLOduration=1.6569385460000001 podStartE2EDuration="4.274581662s" totalImagesPullingTime="2.617643116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:27:56.273514423 +0000 UTC m=+211.253458341" watchObservedRunningTime="2026-06-13 05:27:56.274581662 +0000 UTC m=+211.254525556" Jun 13 05:27:56.698107 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.698053 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:27:56.698305 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:56.698171 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 05:27:56.698305 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:56.698242 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls podName:38a74db6-625f-4222-b9a0-ecf027a7aefa nodeName:}" failed. No retries permitted until 2026-06-13 05:28:00.698226584 +0000 UTC m=+215.678170456 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kf5hd" (UID: "38a74db6-625f-4222-b9a0-ecf027a7aefa") : secret "samples-operator-tls" not found Jun 13 05:27:56.768674 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.768622 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:56.783888 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.783858 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s"] Jun 13 05:27:56.787123 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.787103 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" Jun 13 05:27:56.789517 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.789489 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 13 05:27:56.789631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.789489 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 13 05:27:56.790306 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.790286 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hh24c\"" Jun 13 05:27:56.796678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.796655 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s"] Jun 13 05:27:56.798773 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.798749 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:27:56.798920 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:56.798902 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 05:27:56.798988 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:56.798976 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert podName:61f9d614-9416-47f4-97a8-605c1e86b71e nodeName:}" failed. No retries permitted until 2026-06-13 05:28:00.798957952 +0000 UTC m=+215.778901840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-c5djt" (UID: "61f9d614-9416-47f4-97a8-605c1e86b71e") : secret "networking-console-plugin-cert" not found Jun 13 05:27:56.865568 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.865527 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:56.899903 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.899864 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6wbs\" (UniqueName: \"kubernetes.io/projected/75ad380c-0dcf-4259-a4af-97f81b71a5c5-kube-api-access-s6wbs\") pod \"migrator-d4bcd4867-bp22s\" (UID: \"75ad380c-0dcf-4259-a4af-97f81b71a5c5\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" Jun 13 05:27:56.965946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:56.965843 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:57.001290 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.001253 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6wbs\" (UniqueName: \"kubernetes.io/projected/75ad380c-0dcf-4259-a4af-97f81b71a5c5-kube-api-access-s6wbs\") pod \"migrator-d4bcd4867-bp22s\" (UID: \"75ad380c-0dcf-4259-a4af-97f81b71a5c5\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" Jun 13 05:27:57.009109 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.009055 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6wbs\" (UniqueName: \"kubernetes.io/projected/75ad380c-0dcf-4259-a4af-97f81b71a5c5-kube-api-access-s6wbs\") pod \"migrator-d4bcd4867-bp22s\" (UID: \"75ad380c-0dcf-4259-a4af-97f81b71a5c5\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" Jun 13 05:27:57.095924 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.095890 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" Jun 13 05:27:57.228606 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.228530 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s"] Jun 13 05:27:57.231463 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:27:57.231438 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75ad380c_0dcf_4259_a4af_97f81b71a5c5.slice/crio-3474b8cf8f69ac57db12521dda1ab42993e909ad6e1a3f78d84f8767c14d08fd WatchSource:0}: Error finding container 3474b8cf8f69ac57db12521dda1ab42993e909ad6e1a3f78d84f8767c14d08fd: Status 404 returned error can't find the container with id 3474b8cf8f69ac57db12521dda1ab42993e909ad6e1a3f78d84f8767c14d08fd Jun 13 05:27:57.252507 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.252472 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" event={"ID":"75ad380c-0dcf-4259-a4af-97f81b71a5c5","Type":"ContainerStarted","Data":"3474b8cf8f69ac57db12521dda1ab42993e909ad6e1a3f78d84f8767c14d08fd"} Jun 13 05:27:57.278125 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.278093 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:57.379205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.379164 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:57.510113 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.510007 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:57.611666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.611626 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:57.987613 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:57.987527 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:58.088087 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.088029 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:58.261394 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.261307 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f9b2m"] Jun 13 05:27:58.264925 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.264896 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.267399 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.267376 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 13 05:27:58.267555 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.267416 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mkwd2\"" Jun 13 05:27:58.268300 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.268279 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 13 05:27:58.277032 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.277010 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f9b2m"] Jun 13 05:27:58.305472 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.305435 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:58.363424 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.363388 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:58.415776 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.415720 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.415935 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.415785 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.415935 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.415811 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdcqr\" (UniqueName: \"kubernetes.io/projected/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-api-access-qdcqr\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.415935 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.415846 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f5fda35-89d3-4cee-b5fe-fca68d984436-crio-socket\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.415935 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.415902 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f5fda35-89d3-4cee-b5fe-fca68d984436-data-volume\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.516578 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.516490 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.516578 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.516534 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdcqr\" (UniqueName: \"kubernetes.io/projected/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-api-access-qdcqr\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.516859 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:58.516658 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:27:58.516859 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.516715 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f5fda35-89d3-4cee-b5fe-fca68d984436-crio-socket\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.516859 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:58.516733 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:27:59.016709822 +0000 UTC m=+213.996653708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : secret "insights-runtime-extractor-tls" not found Jun 13 05:27:58.516859 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.516660 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7f5fda35-89d3-4cee-b5fe-fca68d984436-crio-socket\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.516859 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.516765 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f5fda35-89d3-4cee-b5fe-fca68d984436-data-volume\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.517135 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.516920 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.517135 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:58.517020 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:27:58.517135 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:58.517106 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:27:59.017090104 +0000 UTC m=+213.997033992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : configmap "kube-rbac-proxy" not found Jun 13 05:27:58.517299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.517159 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f5fda35-89d3-4cee-b5fe-fca68d984436-data-volume\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:58.527349 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:58.527316 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdcqr\" (UniqueName: \"kubernetes.io/projected/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-api-access-qdcqr\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:59.021114 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.021050 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:59.021297 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.021122 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:27:59.021297 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:59.021198 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:27:59.021297 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:59.021285 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:00.021262527 +0000 UTC m=+215.001206397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : configmap "kube-rbac-proxy" not found Jun 13 05:27:59.021297 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:59.021287 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:27:59.021463 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:27:59.021337 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:00.021324577 +0000 UTC m=+215.001268448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : secret "insights-runtime-extractor-tls" not found Jun 13 05:27:59.264874 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.264785 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" event={"ID":"75ad380c-0dcf-4259-a4af-97f81b71a5c5","Type":"ContainerStarted","Data":"bc765cc3ee2c9e758a4d33be408da2e2828191f82bb546a762641262bd5aa9c0"} Jun 13 05:27:59.264874 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.264865 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" event={"ID":"75ad380c-0dcf-4259-a4af-97f81b71a5c5","Type":"ContainerStarted","Data":"c9ba6b1303a096971073e0e44dcb47310e7342a5c4cc3585f07b0d960c4572ff"} Jun 13 05:27:59.279323 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.279275 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-bp22s" podStartSLOduration=1.734788599 podStartE2EDuration="3.279261348s" totalImagesPullingTime="1.544472749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:27:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:27:59.278344376 +0000 UTC m=+214.258288271" watchObservedRunningTime="2026-06-13 05:27:59.279261348 +0000 UTC m=+214.259205240" Jun 13 05:27:59.364723 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.364696 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:59.463554 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.463516 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:59.582008 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.581976 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6l5v9"] Jun 13 05:27:59.585099 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.585063 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.587609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.587584 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 13 05:27:59.587747 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.587610 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 13 05:27:59.587747 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.587680 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-ddvhn\"" Jun 13 05:27:59.588555 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.588538 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 13 05:27:59.588659 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.588572 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 13 05:27:59.591821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.591799 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6l5v9"] Jun 13 05:27:59.689216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.689184 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:59.727215 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.727189 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6bd29169-7b60-413b-b442-984b2eef1e53-signing-key\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.727326 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.727229 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsh6s\" (UniqueName: \"kubernetes.io/projected/6bd29169-7b60-413b-b442-984b2eef1e53-kube-api-access-rsh6s\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.727385 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.727352 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6bd29169-7b60-413b-b442-984b2eef1e53-signing-cabundle\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.736911 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.736887 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:27:59.828106 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.828055 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6bd29169-7b60-413b-b442-984b2eef1e53-signing-cabundle\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.828207 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.828172 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6bd29169-7b60-413b-b442-984b2eef1e53-signing-key\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.828248 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.828223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsh6s\" (UniqueName: \"kubernetes.io/projected/6bd29169-7b60-413b-b442-984b2eef1e53-kube-api-access-rsh6s\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.828764 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.828742 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6bd29169-7b60-413b-b442-984b2eef1e53-signing-cabundle\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.830713 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.830693 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6bd29169-7b60-413b-b442-984b2eef1e53-signing-key\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.836237 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.836186 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsh6s\" (UniqueName: \"kubernetes.io/projected/6bd29169-7b60-413b-b442-984b2eef1e53-kube-api-access-rsh6s\") pod \"service-ca-7b994bc59-6l5v9\" (UID: \"6bd29169-7b60-413b-b442-984b2eef1e53\") " pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:27:59.894577 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:27:59.894554 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" Jun 13 05:28:00.015946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.015914 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6l5v9"] Jun 13 05:28:00.019226 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:00.019200 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd29169_7b60_413b_b442_984b2eef1e53.slice/crio-571a6df83297ecc31c9fe6598a1ddaab6844e448e3d3a29991fe054d88ec0853 WatchSource:0}: Error finding container 571a6df83297ecc31c9fe6598a1ddaab6844e448e3d3a29991fe054d88ec0853: Status 404 returned error can't find the container with id 571a6df83297ecc31c9fe6598a1ddaab6844e448e3d3a29991fe054d88ec0853 Jun 13 05:28:00.029887 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.029870 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:00.029931 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.029903 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:00.029982 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:00.029962 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:28:00.030062 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:00.030048 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:28:00.030109 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:00.030052 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:02.030025803 +0000 UTC m=+217.009969687 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : configmap "kube-rbac-proxy" not found Jun 13 05:28:00.030152 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:00.030122 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:02.030109559 +0000 UTC m=+217.010053430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : secret "insights-runtime-extractor-tls" not found Jun 13 05:28:00.269418 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.269336 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" event={"ID":"6bd29169-7b60-413b-b442-984b2eef1e53","Type":"ContainerStarted","Data":"6773b58f13aa110816733189ba0f481046dc4ff3874e9013d833fbcbded45020"} Jun 13 05:28:00.269418 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.269384 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" event={"ID":"6bd29169-7b60-413b-b442-984b2eef1e53","Type":"ContainerStarted","Data":"571a6df83297ecc31c9fe6598a1ddaab6844e448e3d3a29991fe054d88ec0853"} Jun 13 05:28:00.285306 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.285254 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-6l5v9" podStartSLOduration=1.285234483 podStartE2EDuration="1.285234483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:27:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:00.283368638 +0000 UTC m=+215.263312531" watchObservedRunningTime="2026-06-13 05:28:00.285234483 +0000 UTC m=+215.265178379" Jun 13 05:28:00.500240 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.500205 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:00.735710 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.735681 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:28:00.735854 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:00.735817 2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 13 05:28:00.735936 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:00.735872 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls podName:38a74db6-625f-4222-b9a0-ecf027a7aefa nodeName:}" failed. No retries permitted until 2026-06-13 05:28:08.735856841 +0000 UTC m=+223.715800901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls") pod "cluster-samples-operator-9547488fd-kf5hd" (UID: "38a74db6-625f-4222-b9a0-ecf027a7aefa") : secret "samples-operator-tls" not found Jun 13 05:28:00.836951 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:00.836928 2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 13 05:28:00.837090 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:00.836987 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert podName:61f9d614-9416-47f4-97a8-605c1e86b71e nodeName:}" failed. No retries permitted until 2026-06-13 05:28:08.836972828 +0000 UTC m=+223.816916699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-c5djt" (UID: "61f9d614-9416-47f4-97a8-605c1e86b71e") : secret "networking-console-plugin-cert" not found Jun 13 05:28:00.837090 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:00.836851 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:28:01.022740 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:01.022649 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:01.124350 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:01.124311 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:01.238007 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:01.237979 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:01.260932 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:01.260911 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xjvfv_8dddcf0a-2034-4b38-a5c5-4592132ddc8a/dns-node-resolver/0.log" Jun 13 05:28:01.339178 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:01.339142 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:01.439666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:01.439637 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:01.720822 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:01.720730 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:01.860688 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:01.860660 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b26pl_1b2682ad-26c1-430c-906c-87fd647f456f/node-ca/0.log" Jun 13 05:28:02.045047 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:02.045007 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:02.045260 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:02.045052 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:02.045260 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:02.045149 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:28:02.045260 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:02.045206 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:28:02.045260 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:02.045218 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:06.045203106 +0000 UTC m=+221.025146980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : configmap "kube-rbac-proxy" not found Jun 13 05:28:02.045260 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:02.045248 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:06.045237513 +0000 UTC m=+221.025181386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : secret "insights-runtime-extractor-tls" not found Jun 13 05:28:02.731744 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:02.731708 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:02.861351 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:02.861318 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7dl2d_6b76dae1-0c22-4a9d-a7ef-3868336a2e2a/serve-healthcheck-canary/0.log" Jun 13 05:28:02.918557 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:02.918504 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:03.261254 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:03.261213 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-bp22s_75ad380c-0dcf-4259-a4af-97f81b71a5c5/migrator/0.log" Jun 13 05:28:03.324969 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:03.324931 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:03.426667 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:03.426636 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:03.461722 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:03.461702 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-bp22s_75ad380c-0dcf-4259-a4af-97f81b71a5c5/graceful-termination/0.log" Jun 13 05:28:03.526824 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:03.526795 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:04.117615 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:04.117585 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:04.665529 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:04.665474 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:04.762127 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:04.762099 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:04.862655 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:04.862631 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:04.963518 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:04.963450 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:05.066571 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:05.066530 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:05.323979 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:05.323956 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:05.519973 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:05.519939 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:05.922461 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:05.922429 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:06.076066 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:06.076038 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:06.076205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:06.076088 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:06.076205 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:06.076159 2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 13 05:28:06.076288 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:06.076207 2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 13 05:28:06.076288 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:06.076217 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:14.076202228 +0000 UTC m=+229.056146099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : configmap "kube-rbac-proxy" not found Jun 13 05:28:06.076288 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:06.076248 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls podName:7f5fda35-89d3-4cee-b5fe-fca68d984436 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:14.076236368 +0000 UTC m=+229.056180239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9b2m" (UID: "7f5fda35-89d3-4cee-b5fe-fca68d984436") : secret "insights-runtime-extractor-tls" not found Jun 13 05:28:06.522967 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:06.522927 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:06.624288 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:06.624251 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:07.116168 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:07.116134 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:07.323701 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:07.323671 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:07.518700 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:07.518621 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:07.565402 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:07.565371 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:07.922015 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:07.921980 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:08.717560 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.717527 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:08.798650 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.798628 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:28:08.801155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.801126 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/38a74db6-625f-4222-b9a0-ecf027a7aefa-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-kf5hd\" (UID: \"38a74db6-625f-4222-b9a0-ecf027a7aefa\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:28:08.852116 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.852092 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" Jun 13 05:28:08.899518 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.899484 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:28:08.902126 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.902101 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61f9d614-9416-47f4-97a8-605c1e86b71e-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-c5djt\" (UID: \"61f9d614-9416-47f4-97a8-605c1e86b71e\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:28:08.924130 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.924100 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:08.952058 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.952032 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" Jun 13 05:28:08.989188 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:08.989162 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd"] Jun 13 05:28:09.087868 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:09.087819 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-c5djt"] Jun 13 05:28:09.091979 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:09.091951 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f9d614_9416_47f4_97a8_605c1e86b71e.slice/crio-daad9b9f2b85841d5571e6ae8ca71dab90f6eaead8053e47ec2468cb87002060 WatchSource:0}: Error finding container daad9b9f2b85841d5571e6ae8ca71dab90f6eaead8053e47ec2468cb87002060: Status 404 returned error can't find the container with id daad9b9f2b85841d5571e6ae8ca71dab90f6eaead8053e47ec2468cb87002060 Jun 13 05:28:09.120317 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:09.120290 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:09.300863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:09.300823 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" event={"ID":"61f9d614-9416-47f4-97a8-605c1e86b71e","Type":"ContainerStarted","Data":"daad9b9f2b85841d5571e6ae8ca71dab90f6eaead8053e47ec2468cb87002060"} Jun 13 05:28:09.301908 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:09.301872 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" event={"ID":"38a74db6-625f-4222-b9a0-ecf027a7aefa","Type":"ContainerStarted","Data":"6adc56f271b34f94c2668def93f828b42a2d6f774c04d817a56e2f89c744ffc0"} Jun 13 05:28:09.524150 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:09.524113 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:09.845886 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:09.845847 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:10.116686 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:10.116601 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:10.522026 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:10.521949 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:10.919704 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:10.919668 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:11.019260 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.019228 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:11.134170 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.134099 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:11.226653 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.226586 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:11.310389 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.310359 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" event={"ID":"61f9d614-9416-47f4-97a8-605c1e86b71e","Type":"ContainerStarted","Data":"07f992f789a841b2caee710d758254191c013e41f5ef70eacbe17f14ba0cd288"} Jun 13 05:28:11.312241 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.312218 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" event={"ID":"38a74db6-625f-4222-b9a0-ecf027a7aefa","Type":"ContainerStarted","Data":"187b6d92f2d94c180e15cc3590c39c70cd3d49257d0cc9e9421c15a673f1d2a9"} Jun 13 05:28:11.312352 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.312273 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" event={"ID":"38a74db6-625f-4222-b9a0-ecf027a7aefa","Type":"ContainerStarted","Data":"d3e3926124c11607168f96fed5b14450077e88972add8df92676b74b41ebb365"} Jun 13 05:28:11.327976 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.327936 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-c5djt" podStartSLOduration=17.166537717 podStartE2EDuration="18.327923169s" totalImagesPullingTime="1.161385452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:11.327332382 +0000 UTC m=+226.307276288" watchObservedRunningTime="2026-06-13 05:28:11.327923169 +0000 UTC m=+226.307867061" Jun 13 05:28:11.329317 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.329292 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:11.342584 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.342527 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-kf5hd" podStartSLOduration=17.381813866999998 podStartE2EDuration="19.342513528s" totalImagesPullingTime="1.960699661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:27:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:11.341949539 +0000 UTC m=+226.321893423" watchObservedRunningTime="2026-06-13 05:28:11.342513528 +0000 UTC m=+226.322457422" Jun 13 05:28:11.920775 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:11.920734 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:12.122525 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:12.122490 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:14.144981 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:14.144942 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:14.145444 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:14.144987 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:14.145497 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:14.145443 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7f5fda35-89d3-4cee-b5fe-fca68d984436-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:14.147473 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:14.147448 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7f5fda35-89d3-4cee-b5fe-fca68d984436-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9b2m\" (UID: \"7f5fda35-89d3-4cee-b5fe-fca68d984436\") " pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:14.176511 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:14.176490 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f9b2m" Jun 13 05:28:14.320444 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:14.320414 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f9b2m"] Jun 13 05:28:14.323292 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:14.323264 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5fda35_89d3_4cee_b5fe_fca68d984436.slice/crio-548363d9a2adb6a62606a4d838b27f9a06f9d3ec953e12dd5425fd256c88bc69 WatchSource:0}: Error finding container 548363d9a2adb6a62606a4d838b27f9a06f9d3ec953e12dd5425fd256c88bc69: Status 404 returned error can't find the container with id 548363d9a2adb6a62606a4d838b27f9a06f9d3ec953e12dd5425fd256c88bc69 Jun 13 05:28:15.326906 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:15.326852 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f9b2m" event={"ID":"7f5fda35-89d3-4cee-b5fe-fca68d984436","Type":"ContainerStarted","Data":"548363d9a2adb6a62606a4d838b27f9a06f9d3ec953e12dd5425fd256c88bc69"} Jun 13 05:28:16.911197 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:16.911160 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:16.962468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:16.962432 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:17.924036 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:17.924002 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg"] Jun 13 05:28:17.926762 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:17.926745 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" Jun 13 05:28:17.930274 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:17.930255 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 13 05:28:17.930373 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:17.930255 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vmjk9\"" Jun 13 05:28:17.936437 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:17.936381 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg"] Jun 13 05:28:17.978223 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:17.978193 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee08c043-6837-4e29-a4a6-8e9c4a5b4f38-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2z7dg\" (UID: \"ee08c043-6837-4e29-a4a6-8e9c4a5b4f38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" Jun 13 05:28:18.031445 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.031406 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:18.078581 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.078549 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee08c043-6837-4e29-a4a6-8e9c4a5b4f38-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2z7dg\" (UID: \"ee08c043-6837-4e29-a4a6-8e9c4a5b4f38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" Jun 13 05:28:18.081224 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.081201 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ee08c043-6837-4e29-a4a6-8e9c4a5b4f38-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-2z7dg\" (UID: \"ee08c043-6837-4e29-a4a6-8e9c4a5b4f38\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" Jun 13 05:28:18.129501 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.129447 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:18.231703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.231620 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:18.236410 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.236390 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" Jun 13 05:28:18.342017 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.341984 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f9b2m" event={"ID":"7f5fda35-89d3-4cee-b5fe-fca68d984436","Type":"ContainerStarted","Data":"8aab5009f878902c66527674bc15bc836b46091eb40c8185d846a7e193b2be7a"} Jun 13 05:28:18.361157 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.361127 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg"] Jun 13 05:28:18.364134 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:18.364107 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee08c043_6837_4e29_a4a6_8e9c4a5b4f38.slice/crio-bb1b9eff4efdb15255127798a38786eb002af6a5f5761c37e8287ff43f7cfc00 WatchSource:0}: Error finding container bb1b9eff4efdb15255127798a38786eb002af6a5f5761c37e8287ff43f7cfc00: Status 404 returned error can't find the container with id bb1b9eff4efdb15255127798a38786eb002af6a5f5761c37e8287ff43f7cfc00 Jun 13 05:28:18.987780 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:18.987685 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:19.083183 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.083144 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:19.183556 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.183510 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:19.283293 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.283261 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:19.346754 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.346722 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f9b2m" event={"ID":"7f5fda35-89d3-4cee-b5fe-fca68d984436","Type":"ContainerStarted","Data":"5f268f2adcf88105e22974cd15af597b9a2be17710fc0c0846eae10d48077c51"} Jun 13 05:28:19.348490 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.348460 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" event={"ID":"ee08c043-6837-4e29-a4a6-8e9c4a5b4f38","Type":"ContainerStarted","Data":"bb1b9eff4efdb15255127798a38786eb002af6a5f5761c37e8287ff43f7cfc00"} Jun 13 05:28:19.482804 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.482751 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:19.593260 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.593176 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:19.683191 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.683055 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:19.879742 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:19.879650 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:20.354581 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:20.354533 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" event={"ID":"ee08c043-6837-4e29-a4a6-8e9c4a5b4f38","Type":"ContainerStarted","Data":"fd098261bf3607a833aa5dda3f441ca45b6dfc7af6d28e2b00e3091930b72494"} Jun 13 05:28:20.355041 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:20.354751 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" Jun 13 05:28:20.359980 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:20.359956 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" Jun 13 05:28:20.369915 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:20.369861 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-2z7dg" podStartSLOduration=2.439909103 podStartE2EDuration="3.369840923s" totalImagesPullingTime="929.93182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:20.36831911 +0000 UTC m=+235.348263004" watchObservedRunningTime="2026-06-13 05:28:20.369840923 +0000 UTC m=+235.349784816" Jun 13 05:28:20.858586 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:20.858557 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:20.972875 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:20.972837 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:21.073768 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:21.073734 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:21.189618 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:21.189540 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:21.256261 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:21.256231 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:21.360143 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:21.360110 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f9b2m" event={"ID":"7f5fda35-89d3-4cee-b5fe-fca68d984436","Type":"ContainerStarted","Data":"22b482dde94e2822a7fb892d0af98fd9d8cba35587f42fb8ce67945dce964203"} Jun 13 05:28:21.377151 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:21.377111 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f9b2m" podStartSLOduration=17.285377605 podStartE2EDuration="23.377096777s" totalImagesPullingTime="6.091719172s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:27:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:21.375915398 +0000 UTC m=+236.355859284" watchObservedRunningTime="2026-06-13 05:28:21.377096777 +0000 UTC m=+236.357040667" Jun 13 05:28:21.597560 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:21.597524 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:22.075577 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:22.075538 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:22.125395 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:22.125351 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:23.817229 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:23.817191 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:26.322255 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.322192 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:26.528754 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.528720 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:26.574855 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.574790 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm"] Jun 13 05:28:26.579314 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.579295 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.581825 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.581804 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j4hnb"] Jun 13 05:28:26.582041 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.582017 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 13 05:28:26.582142 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.582036 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 13 05:28:26.582278 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.582251 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 13 05:28:26.582393 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.582319 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 13 05:28:26.583435 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.583135 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 13 05:28:26.583435 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.583182 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 13 05:28:26.583435 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.583141 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dfxxf\"" Jun 13 05:28:26.585383 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.585365 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.590626 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.590607 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bdkzl\"" Jun 13 05:28:26.590725 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.590693 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 13 05:28:26.590988 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.590970 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 13 05:28:26.591255 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.591238 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 13 05:28:26.595102 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.594758 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm"] Jun 13 05:28:26.636122 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636098 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.636122 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636132 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-sys\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636290 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636171 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6585f9-c7db-4b93-85d4-4509db0249a1-metrics-client-ca\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636290 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636199 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9p8v\" (UniqueName: \"kubernetes.io/projected/ca6585f9-c7db-4b93-85d4-4509db0249a1-kube-api-access-z9p8v\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636290 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636249 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e574496f-f23d-450c-99f2-faefce8c0768-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.636290 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636274 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.636477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636297 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636331 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e574496f-f23d-450c-99f2-faefce8c0768-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.636477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636361 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-textfile\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.636477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636424 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-wtmp\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636447 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-tls\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636471 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636512 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-root\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.636714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.636538 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwmzg\" (UniqueName: \"kubernetes.io/projected/e574496f-f23d-450c-99f2-faefce8c0768-kube-api-access-lwmzg\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.645973 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.645945 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:26.737141 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737115 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e574496f-f23d-450c-99f2-faefce8c0768-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.737239 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.737239 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737184 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737239 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737219 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e574496f-f23d-450c-99f2-faefce8c0768-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.737406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737251 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-textfile\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737295 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.737406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737325 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-wtmp\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737350 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-tls\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737376 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737651 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737415 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-root\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737651 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737444 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwmzg\" (UniqueName: \"kubernetes.io/projected/e574496f-f23d-450c-99f2-faefce8c0768-kube-api-access-lwmzg\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.737651 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737477 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.737651 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737504 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-sys\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737651 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737546 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6585f9-c7db-4b93-85d4-4509db0249a1-metrics-client-ca\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737651 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737575 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9p8v\" (UniqueName: \"kubernetes.io/projected/ca6585f9-c7db-4b93-85d4-4509db0249a1-kube-api-access-z9p8v\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.737651 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737637 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e574496f-f23d-450c-99f2-faefce8c0768-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.737987 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737890 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e574496f-f23d-450c-99f2-faefce8c0768-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.737987 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.737890 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-sys\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.738112 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.738047 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-wtmp\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.738220 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.738194 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.738285 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.738248 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.738342 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:26.738303 2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 13 05:28:26.738401 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:28:26.738352 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-tls podName:ca6585f9-c7db-4b93-85d4-4509db0249a1 nodeName:}" failed. No retries permitted until 2026-06-13 05:28:27.238336313 +0000 UTC m=+242.218280184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-tls") pod "node-exporter-j4hnb" (UID: "ca6585f9-c7db-4b93-85d4-4509db0249a1") : secret "node-exporter-tls" not found Jun 13 05:28:26.738401 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.738381 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca6585f9-c7db-4b93-85d4-4509db0249a1-metrics-client-ca\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.738598 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.738574 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca6585f9-c7db-4b93-85d4-4509db0249a1-root\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.738728 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.738709 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-textfile\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.740141 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.740118 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.740463 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.740437 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:26.740794 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.740771 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.740923 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.740906 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e574496f-f23d-450c-99f2-faefce8c0768-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.745167 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.745134 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9p8v\" (UniqueName: \"kubernetes.io/projected/ca6585f9-c7db-4b93-85d4-4509db0249a1-kube-api-access-z9p8v\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:26.746401 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.746381 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwmzg\" (UniqueName: \"kubernetes.io/projected/e574496f-f23d-450c-99f2-faefce8c0768-kube-api-access-lwmzg\") pod \"kube-state-metrics-678bc549d7-f8vjm\" (UID: \"e574496f-f23d-450c-99f2-faefce8c0768\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.841705 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.841648 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:26.892328 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.892301 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" Jun 13 05:28:26.940200 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:26.940164 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:27.023850 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.023816 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm"] Jun 13 05:28:27.025819 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.025791 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:27.028511 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:27.028478 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode574496f_f23d_450c_99f2_faefce8c0768.slice/crio-9992a38163b759df789b68a7b769719b1bd2fd3ff8d311ea4d291154d52bce6d WatchSource:0}: Error finding container 9992a38163b759df789b68a7b769719b1bd2fd3ff8d311ea4d291154d52bce6d: Status 404 returned error can't find the container with id 9992a38163b759df789b68a7b769719b1bd2fd3ff8d311ea4d291154d52bce6d Jun 13 05:28:27.119984 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.119922 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:27.241801 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.241774 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-tls\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:27.244041 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.244023 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca6585f9-c7db-4b93-85d4-4509db0249a1-node-exporter-tls\") pod \"node-exporter-j4hnb\" (UID: \"ca6585f9-c7db-4b93-85d4-4509db0249a1\") " pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:27.382190 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.382129 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" event={"ID":"e574496f-f23d-450c-99f2-faefce8c0768","Type":"ContainerStarted","Data":"9992a38163b759df789b68a7b769719b1bd2fd3ff8d311ea4d291154d52bce6d"} Jun 13 05:28:27.498257 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.498225 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j4hnb" Jun 13 05:28:27.516489 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:27.516455 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6585f9_c7db_4b93_85d4_4509db0249a1.slice/crio-77dab8057499d2bb07b08850a7e8b546fe59f476642c9d94228371d7b64a0b6c WatchSource:0}: Error finding container 77dab8057499d2bb07b08850a7e8b546fe59f476642c9d94228371d7b64a0b6c: Status 404 returned error can't find the container with id 77dab8057499d2bb07b08850a7e8b546fe59f476642c9d94228371d7b64a0b6c Jun 13 05:28:27.540253 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.540223 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:27.655196 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.655115 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:27.658834 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.658799 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:28:27.663842 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.663818 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.666171 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666137 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 05:28:27.666290 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666262 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 05:28:27.666290 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666274 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cfgd5\"" Jun 13 05:28:27.666614 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666434 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 05:28:27.666614 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666447 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 05:28:27.666614 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666491 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 05:28:27.666614 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666513 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 05:28:27.666614 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666585 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 05:28:27.666925 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666780 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 05:28:27.666925 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.666825 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 05:28:27.678427 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.678340 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:28:27.740558 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.740526 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:27.744526 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744498 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-tls-assets\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744693 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744553 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744693 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744583 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gk77\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-kube-api-access-7gk77\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744693 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744614 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744693 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744637 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744693 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744661 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-config-volume\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744692 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744726 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-web-config\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744748 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744783 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-config-out\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744811 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744881 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.744953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.744905 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846085 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846051 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846196 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846097 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846196 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846124 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-tls-assets\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846196 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846164 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846196 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846183 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gk77\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-kube-api-access-7gk77\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846389 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846213 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846389 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846351 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846484 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846394 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-config-volume\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846484 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846428 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846484 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846478 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-web-config\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846650 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846506 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846650 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846539 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-config-out\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846650 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846579 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.846650 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.846603 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.847652 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.847623 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.848168 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.848142 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.849413 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.849376 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.849546 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.849526 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.850061 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.849780 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-tls-assets\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.850061 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.849931 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-config-volume\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.850217 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.850154 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-config-out\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.850413 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.850392 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.850555 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.850525 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.850937 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.850911 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.851205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.851188 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-web-config\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.853131 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.853111 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gk77\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-kube-api-access-7gk77\") pod \"alertmanager-main-0\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:27.976285 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:27.976216 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:28:28.387621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:28.387580 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j4hnb" event={"ID":"ca6585f9-c7db-4b93-85d4-4509db0249a1","Type":"ContainerStarted","Data":"77dab8057499d2bb07b08850a7e8b546fe59f476642c9d94228371d7b64a0b6c"} Jun 13 05:28:28.679507 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:28.679427 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:28:28.684969 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:28.684928 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414cd489_5395_4c0a_bf84_592406417696.slice/crio-4785edd755b84e399e9f120215e5390a4552de5f3f7d89e8a95b1d586f066ad0 WatchSource:0}: Error finding container 4785edd755b84e399e9f120215e5390a4552de5f3f7d89e8a95b1d586f066ad0: Status 404 returned error can't find the container with id 4785edd755b84e399e9f120215e5390a4552de5f3f7d89e8a95b1d586f066ad0 Jun 13 05:28:29.393821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.393786 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" event={"ID":"e574496f-f23d-450c-99f2-faefce8c0768","Type":"ContainerStarted","Data":"b7baa9b4a18ac1f7be6e5bec08f73fded6a720784ea6b16cd7356e9b7f2e58c9"} Jun 13 05:28:29.394206 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.393843 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" event={"ID":"e574496f-f23d-450c-99f2-faefce8c0768","Type":"ContainerStarted","Data":"031d156163d86bd9decaba49c1c2dc31f27eb4c68f33691d657559c43787ebaf"} Jun 13 05:28:29.394206 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.393866 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" event={"ID":"e574496f-f23d-450c-99f2-faefce8c0768","Type":"ContainerStarted","Data":"50c8bdf46a2cd4867f7e25e184b940cd133a8710563a7d61246bf3f70cae1fec"} Jun 13 05:28:29.395365 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.395335 2584 generic.go:356] "Generic (PLEG): container finished" podID="ca6585f9-c7db-4b93-85d4-4509db0249a1" containerID="c4fa971a7d1397c4211b67ac8ec27b3da5d94ca3b5c8afcfbad240d9745f67e5" exitCode=0 Jun 13 05:28:29.395493 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.395416 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j4hnb" event={"ID":"ca6585f9-c7db-4b93-85d4-4509db0249a1","Type":"ContainerDied","Data":"c4fa971a7d1397c4211b67ac8ec27b3da5d94ca3b5c8afcfbad240d9745f67e5"} Jun 13 05:28:29.396678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.396658 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerStarted","Data":"4785edd755b84e399e9f120215e5390a4552de5f3f7d89e8a95b1d586f066ad0"} Jun 13 05:28:29.411048 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.410956 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-f8vjm" podStartSLOduration=1.9100535650000001 podStartE2EDuration="3.41093749s" totalImagesPullingTime="1.500883925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:29.410762211 +0000 UTC m=+244.390706106" watchObservedRunningTime="2026-06-13 05:28:29.41093749 +0000 UTC m=+244.390881384" Jun 13 05:28:29.492953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.492783 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:29.573857 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.573825 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:29.715479 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:29.715400 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:30.402849 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:30.402799 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j4hnb" event={"ID":"ca6585f9-c7db-4b93-85d4-4509db0249a1","Type":"ContainerStarted","Data":"e53e87dcc624b31bfb5e69a09ef058b7b0e39eebecf9d1c5dbabfa07b0cd56a4"} Jun 13 05:28:30.403231 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:30.402849 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j4hnb" event={"ID":"ca6585f9-c7db-4b93-85d4-4509db0249a1","Type":"ContainerStarted","Data":"33c8d98683b6016df43d1fa3da695da02d7cdc624a279672e9af9215ff64576b"} Jun 13 05:28:30.404437 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:30.404416 2584 generic.go:356] "Generic (PLEG): container finished" podID="414cd489-5395-4c0a-bf84-592406417696" containerID="59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f" exitCode=0 Jun 13 05:28:30.404544 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:30.404497 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerDied","Data":"59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f"} Jun 13 05:28:30.420876 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:30.420836 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j4hnb" podStartSLOduration=3.31515804 podStartE2EDuration="4.420821804s" totalImagesPullingTime="1.014506167s" totalInitContainerRuntime="91.157597ms" isStatefulPod=true podCreationTimestamp="2026-06-13 05:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:30.419979382 +0000 UTC m=+245.399923311" watchObservedRunningTime="2026-06-13 05:28:30.420821804 +0000 UTC m=+245.400765697" Jun 13 05:28:30.464630 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:30.464598 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:31.330802 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:31.330761 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:31.429121 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:31.429067 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:31.530320 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:31.530281 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:32.414017 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.413937 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerStarted","Data":"131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1"} Jun 13 05:28:32.414017 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.414012 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerStarted","Data":"342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f"} Jun 13 05:28:32.414209 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.414038 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerStarted","Data":"81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562"} Jun 13 05:28:32.414209 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.414063 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerStarted","Data":"3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474"} Jun 13 05:28:32.414209 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.414113 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerStarted","Data":"26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b"} Jun 13 05:28:32.766242 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.766159 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:28:32.767949 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.767921 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:32.769863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.769841 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.772378 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.772355 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 13 05:28:32.772533 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.772425 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 13 05:28:32.772533 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.772366 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 13 05:28:32.772672 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.772652 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 13 05:28:32.773118 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.773094 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 13 05:28:32.773212 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.773119 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 13 05:28:32.773212 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.773098 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 13 05:28:32.773212 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.773102 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 13 05:28:32.773374 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.773316 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 13 05:28:32.773654 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.773632 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 13 05:28:32.773763 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.773659 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 13 05:28:32.774791 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.774769 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 13 05:28:32.775052 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.775033 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 13 05:28:32.775260 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.775161 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b5jss\"" Jun 13 05:28:32.775359 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.775251 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 05:28:32.775420 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.775185 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-35idkr1q95mlb\"" Jun 13 05:28:32.776232 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.776210 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 13 05:28:32.785742 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.785723 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:28:32.794237 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794211 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794357 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794258 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794357 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794295 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794357 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794326 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794357 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794349 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794565 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794374 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794565 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794401 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794565 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794427 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794565 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794452 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794565 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794482 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794570 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx89l\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-kube-api-access-hx89l\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794660 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794726 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794753 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794806 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.794821 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794822 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.795036 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794841 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.795036 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794858 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.795036 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794876 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.795036 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.794891 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.895930 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.895893 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx89l\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-kube-api-access-hx89l\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.895930 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.895934 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896175 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896117 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896175 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896154 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896277 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896213 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896277 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896237 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896438 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896272 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896438 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896303 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896438 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896327 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896438 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896354 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896438 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896389 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896438 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896422 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896456 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896491 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896529 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896561 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896572 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896594 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896621 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896650 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.896748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.896690 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.897364 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.897107 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.897419 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.897375 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.897903 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.897607 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.897903 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.897737 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.899037 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.898730 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.899037 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.898961 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.899787 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.899735 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.900329 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.900284 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.900730 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.900686 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.900817 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.900760 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.901593 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.901566 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.901593 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.901583 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.902058 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.902030 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config-out\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.902493 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.902464 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-web-config\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.902670 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.902648 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.902847 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.902824 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.903676 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.903654 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.903836 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.903817 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx89l\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-kube-api-access-hx89l\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:32.903942 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:32.903919 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:33.083107 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:33.083063 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:33.217259 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:33.217229 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:28:33.219301 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:33.219275 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod827b9508_ff5d_4932_b55b_0236fe1e6b3f.slice/crio-8465406a2d260749c0a3c8157e9a15cccf4fcb384ecd37e783a5a1c8e2ea8576 WatchSource:0}: Error finding container 8465406a2d260749c0a3c8157e9a15cccf4fcb384ecd37e783a5a1c8e2ea8576: Status 404 returned error can't find the container with id 8465406a2d260749c0a3c8157e9a15cccf4fcb384ecd37e783a5a1c8e2ea8576 Jun 13 05:28:33.421680 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:33.421639 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerStarted","Data":"cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962"} Jun 13 05:28:33.423138 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:33.423112 2584 generic.go:356] "Generic (PLEG): container finished" podID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" exitCode=0 Jun 13 05:28:33.423236 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:33.423148 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerDied","Data":"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6"} Jun 13 05:28:33.423236 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:33.423202 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerStarted","Data":"8465406a2d260749c0a3c8157e9a15cccf4fcb384ecd37e783a5a1c8e2ea8576"} Jun 13 05:28:33.448308 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:33.448215 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.63755767 podStartE2EDuration="6.448197003s" totalImagesPullingTime="3.793357947s" totalInitContainerRuntime="17.281386ms" isStatefulPod=false podCreationTimestamp="2026-06-13 05:28:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:33.446250626 +0000 UTC m=+248.426194548" watchObservedRunningTime="2026-06-13 05:28:33.448197003 +0000 UTC m=+248.428140897" Jun 13 05:28:34.280858 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:34.280809 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:34.327226 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:34.327193 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:36.428175 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:36.428138 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:28:36.430761 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:36.430727 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd190152-b46d-4522-ac9d-cc8f64fae7d4-metrics-certs\") pod \"network-metrics-daemon-trmhx\" (UID: \"cd190152-b46d-4522-ac9d-cc8f64fae7d4\") " pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:28:36.436991 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:36.436933 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerStarted","Data":"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d"} Jun 13 05:28:36.437104 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:36.437019 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerStarted","Data":"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e"} Jun 13 05:28:36.482646 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:36.482626 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mn5hn\"" Jun 13 05:28:36.491106 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:36.491055 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-trmhx" Jun 13 05:28:36.613103 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:36.613065 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-trmhx"] Jun 13 05:28:36.615172 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:28:36.615150 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd190152_b46d_4522_ac9d_cc8f64fae7d4.slice/crio-4bcc50ab5f0e42210aef634f0a0375b210234c38b5f4f2c0e6ce421e58920d86 WatchSource:0}: Error finding container 4bcc50ab5f0e42210aef634f0a0375b210234c38b5f4f2c0e6ce421e58920d86: Status 404 returned error can't find the container with id 4bcc50ab5f0e42210aef634f0a0375b210234c38b5f4f2c0e6ce421e58920d86 Jun 13 05:28:37.442911 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:37.442879 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-trmhx" event={"ID":"cd190152-b46d-4522-ac9d-cc8f64fae7d4","Type":"ContainerStarted","Data":"4bcc50ab5f0e42210aef634f0a0375b210234c38b5f4f2c0e6ce421e58920d86"} Jun 13 05:28:37.678753 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:37.678709 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:37.778872 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:37.778840 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:38.448668 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.448639 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-trmhx" event={"ID":"cd190152-b46d-4522-ac9d-cc8f64fae7d4","Type":"ContainerStarted","Data":"6bc0fda95964a9b82a7ad3c603b8ea75834f3aa394cefbd9f73caac65e45f4fd"} Jun 13 05:28:38.449033 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.448699 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-trmhx" event={"ID":"cd190152-b46d-4522-ac9d-cc8f64fae7d4","Type":"ContainerStarted","Data":"d4ecd8a5a59612cdbdb2e94dc9f9e7b8d1824a61375a06bfa95dbd74abda6062"} Jun 13 05:28:38.452126 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.452100 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerStarted","Data":"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5"} Jun 13 05:28:38.452236 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.452167 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerStarted","Data":"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f"} Jun 13 05:28:38.452236 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.452212 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerStarted","Data":"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c"} Jun 13 05:28:38.452335 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.452254 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerStarted","Data":"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111"} Jun 13 05:28:38.464048 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.463997 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-trmhx" podStartSLOduration=251.026856729 podStartE2EDuration="4m12.463981662s" totalImagesPullingTime="1.437124933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:24:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:38.462492546 +0000 UTC m=+253.442436455" watchObservedRunningTime="2026-06-13 05:28:38.463981662 +0000 UTC m=+253.443925555" Jun 13 05:28:38.487276 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.487240 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.961486994 podStartE2EDuration="6.487223808s" totalImagesPullingTime="4.50918443s" totalInitContainerRuntime="16.552384ms" isStatefulPod=false podCreationTimestamp="2026-06-13 05:28:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:28:38.486359424 +0000 UTC m=+253.466303353" watchObservedRunningTime="2026-06-13 05:28:38.487223808 +0000 UTC m=+253.467167700" Jun 13 05:28:38.545983 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.545959 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:38.646288 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:38.646232 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:40.106887 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:40.106853 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:40.207613 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:40.207579 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:43.084212 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:43.084117 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:28:44.488192 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:44.488149 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:44.537732 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:44.537699 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:46.515314 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:46.515270 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:46.570270 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:46.570239 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:48.680740 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:48.680702 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:48.732651 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:48.732620 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:52.559247 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:52.559217 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:52.660041 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:52.660012 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:56.163094 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:56.163028 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:28:56.263454 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:28:56.263406 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:05.841992 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:05.841961 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:05.889401 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:05.889375 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:07.056770 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:07.056740 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:07.109319 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:07.109287 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:08.108416 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:08.108384 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w54d4" podUID="c8014faf-8210-422e-afed-a4af9eb97e04" Jun 13 05:29:08.108736 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:08.108420 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" podUID="3fa0a34c-57db-4147-acca-f63c1ccdae56" Jun 13 05:29:08.562884 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:08.562854 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:29:08.563035 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:08.562858 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w54d4" Jun 13 05:29:11.242255 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.242223 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:29:11.242613 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.242261 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:29:11.244710 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.244679 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c8014faf-8210-422e-afed-a4af9eb97e04-metrics-tls\") pod \"dns-default-w54d4\" (UID: \"c8014faf-8210-422e-afed-a4af9eb97e04\") " pod="openshift-dns/dns-default-w54d4" Jun 13 05:29:11.244829 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.244760 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"image-registry-5b4d6cd465-vk697\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:29:11.266779 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.266756 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tdxg2\"" Jun 13 05:29:11.266880 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.266756 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-24sgs\"" Jun 13 05:29:11.274738 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.274723 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w54d4" Jun 13 05:29:11.274837 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.274821 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:29:11.413684 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.413617 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w54d4"] Jun 13 05:29:11.417369 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:29:11.417341 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8014faf_8210_422e_afed_a4af9eb97e04.slice/crio-ef03e7b385c2399e8fcef9aabfb5ad4004d660c8e3cb6a3cc71486c92f073acf WatchSource:0}: Error finding container ef03e7b385c2399e8fcef9aabfb5ad4004d660c8e3cb6a3cc71486c92f073acf: Status 404 returned error can't find the container with id ef03e7b385c2399e8fcef9aabfb5ad4004d660c8e3cb6a3cc71486c92f073acf Jun 13 05:29:11.431875 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.431852 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b4d6cd465-vk697"] Jun 13 05:29:11.435191 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:29:11.435169 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fa0a34c_57db_4147_acca_f63c1ccdae56.slice/crio-30a29c0412c733fda3f48c5f96044d3ddf4ce23a9350a2e579f673fb83490ec2 WatchSource:0}: Error finding container 30a29c0412c733fda3f48c5f96044d3ddf4ce23a9350a2e579f673fb83490ec2: Status 404 returned error can't find the container with id 30a29c0412c733fda3f48c5f96044d3ddf4ce23a9350a2e579f673fb83490ec2 Jun 13 05:29:11.574366 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.574335 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w54d4" event={"ID":"c8014faf-8210-422e-afed-a4af9eb97e04","Type":"ContainerStarted","Data":"ef03e7b385c2399e8fcef9aabfb5ad4004d660c8e3cb6a3cc71486c92f073acf"} Jun 13 05:29:11.576016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.575979 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" event={"ID":"3fa0a34c-57db-4147-acca-f63c1ccdae56","Type":"ContainerStarted","Data":"2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118"} Jun 13 05:29:11.576165 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.576023 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" event={"ID":"3fa0a34c-57db-4147-acca-f63c1ccdae56","Type":"ContainerStarted","Data":"30a29c0412c733fda3f48c5f96044d3ddf4ce23a9350a2e579f673fb83490ec2"} Jun 13 05:29:11.576165 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.576131 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:29:11.594507 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:11.594450 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" podStartSLOduration=285.594430331 podStartE2EDuration="4m45.594430331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:29:11.593795886 +0000 UTC m=+286.573739779" watchObservedRunningTime="2026-06-13 05:29:11.594430331 +0000 UTC m=+286.574374226" Jun 13 05:29:13.586321 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:13.586245 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w54d4" event={"ID":"c8014faf-8210-422e-afed-a4af9eb97e04","Type":"ContainerStarted","Data":"1998adc08daaf80efe27d2973293037a277f79127dfd678ea7e403888757d4f8"} Jun 13 05:29:13.586321 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:13.586296 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w54d4" event={"ID":"c8014faf-8210-422e-afed-a4af9eb97e04","Type":"ContainerStarted","Data":"0230617f19049a724e6ccbb3785fb2f2f3e54b7973026520ba63f0e9a12d7170"} Jun 13 05:29:13.586691 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:13.586339 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w54d4" Jun 13 05:29:13.601562 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:13.601515 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w54d4" podStartSLOduration=250.722377644 podStartE2EDuration="4m12.601502597s" totalImagesPullingTime="1.879124953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:29:13.60129884 +0000 UTC m=+288.581242735" watchObservedRunningTime="2026-06-13 05:29:13.601502597 +0000 UTC m=+288.581446501" Jun 13 05:29:15.438905 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:15.438877 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:22.621435 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:22.621407 2584 generic.go:356] "Generic (PLEG): container finished" podID="1dc53e88-5f95-4d02-ad63-033e02adc4b8" containerID="405873e164197f3c247dde135b114279fa4f8fad36ce92514c3ec1dfc4e33fe3" exitCode=0 Jun 13 05:29:22.621731 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:22.621488 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" event={"ID":"1dc53e88-5f95-4d02-ad63-033e02adc4b8","Type":"ContainerDied","Data":"405873e164197f3c247dde135b114279fa4f8fad36ce92514c3ec1dfc4e33fe3"} Jun 13 05:29:22.621773 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:22.621748 2584 scope.go:117] "RemoveContainer" containerID="405873e164197f3c247dde135b114279fa4f8fad36ce92514c3ec1dfc4e33fe3" Jun 13 05:29:23.592181 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:23.592153 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w54d4" Jun 13 05:29:23.627493 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:23.627468 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-xqqgn" event={"ID":"1dc53e88-5f95-4d02-ad63-033e02adc4b8","Type":"ContainerStarted","Data":"0c2b000173aaffdb743078c511e35ce04cf63a35b31bacf99a6b082e22951d06"} Jun 13 05:29:25.044763 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:25.044729 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:25.100365 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:25.100338 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:25.444689 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:25.444620 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:29:25.445346 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:25.445324 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:29:25.449430 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:25.449411 2584 kubelet.go:1648] "Image garbage collection succeeded" Jun 13 05:29:27.642942 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:27.642884 2584 generic.go:356] "Generic (PLEG): container finished" podID="94b82225-6fde-42c6-9517-bcc799724be2" containerID="ef51eb255195ef0ce6ba28cb14e0355c8e59e2023df86656ba36fea2a4841e07" exitCode=0 Jun 13 05:29:27.642942 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:27.642924 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" event={"ID":"94b82225-6fde-42c6-9517-bcc799724be2","Type":"ContainerDied","Data":"ef51eb255195ef0ce6ba28cb14e0355c8e59e2023df86656ba36fea2a4841e07"} Jun 13 05:29:27.643302 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:27.643214 2584 scope.go:117] "RemoveContainer" containerID="ef51eb255195ef0ce6ba28cb14e0355c8e59e2023df86656ba36fea2a4841e07" Jun 13 05:29:27.984706 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:27.984620 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:28.092150 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:28.092121 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:28.140591 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:28.140560 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:28.404250 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:28.404215 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:28.451638 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:28.451606 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:28.648471 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:28.648440 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-kx8lz" event={"ID":"94b82225-6fde-42c6-9517-bcc799724be2","Type":"ContainerStarted","Data":"245537fbde3d83a82fd8efa8cb27f65704c324b037c06048fff3908af2ecd758"} Jun 13 05:29:30.419761 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:30.419737 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_414cd489-5395-4c0a-bf84-592406417696/init-config-reloader/0.log" Jun 13 05:29:30.620789 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:30.620762 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_414cd489-5395-4c0a-bf84-592406417696/alertmanager/0.log" Jun 13 05:29:30.819893 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:30.819874 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_414cd489-5395-4c0a-bf84-592406417696/config-reloader/0.log" Jun 13 05:29:31.020352 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:31.020329 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_414cd489-5395-4c0a-bf84-592406417696/kube-rbac-proxy-web/0.log" Jun 13 05:29:31.220583 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:31.220540 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_414cd489-5395-4c0a-bf84-592406417696/kube-rbac-proxy/0.log" Jun 13 05:29:31.279696 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:31.279672 2584 patch_prober.go:28] interesting pod/image-registry-5b4d6cd465-vk697 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 13 05:29:31.279785 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:31.279716 2584 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" podUID="3fa0a34c-57db-4147-acca-f63c1ccdae56" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 13 05:29:31.420426 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:31.420407 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_414cd489-5395-4c0a-bf84-592406417696/kube-rbac-proxy-metric/0.log" Jun 13 05:29:31.621013 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:31.620990 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_414cd489-5395-4c0a-bf84-592406417696/prom-label-proxy/0.log" Jun 13 05:29:32.020675 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:32.020619 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8vjm_e574496f-f23d-450c-99f2-faefce8c0768/kube-state-metrics/0.log" Jun 13 05:29:32.220624 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:32.220607 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8vjm_e574496f-f23d-450c-99f2-faefce8c0768/kube-rbac-proxy-main/0.log" Jun 13 05:29:32.420895 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:32.420873 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8vjm_e574496f-f23d-450c-99f2-faefce8c0768/kube-rbac-proxy-self/0.log" Jun 13 05:29:32.584237 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:32.584219 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:29:32.701221 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:32.701157 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:32.752419 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:32.752387 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:32.897611 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:32.897586 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:32.948779 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:32.948757 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:33.083684 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:33.083659 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:33.102580 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:33.102561 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:33.619880 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:33.619858 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4hnb_ca6585f9-c7db-4b93-85d4-4509db0249a1/init-textfile/0.log" Jun 13 05:29:33.681501 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:33.681482 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:33.821527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:33.821506 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4hnb_ca6585f9-c7db-4b93-85d4-4509db0249a1/node-exporter/0.log" Jun 13 05:29:34.020324 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:34.020268 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4hnb_ca6585f9-c7db-4b93-85d4-4509db0249a1/kube-rbac-proxy/0.log" Jun 13 05:29:34.391744 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:34.391717 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:34.439923 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:34.439898 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:35.420193 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:35.420164 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_827b9508-ff5d-4932-b55b-0236fe1e6b3f/init-config-reloader/0.log" Jun 13 05:29:35.624874 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:35.624854 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_827b9508-ff5d-4932-b55b-0236fe1e6b3f/prometheus/0.log" Jun 13 05:29:35.819891 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:35.819867 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_827b9508-ff5d-4932-b55b-0236fe1e6b3f/config-reloader/0.log" Jun 13 05:29:36.021387 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:36.021366 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_827b9508-ff5d-4932-b55b-0236fe1e6b3f/thanos-sidecar/0.log" Jun 13 05:29:36.219877 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:36.219816 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_827b9508-ff5d-4932-b55b-0236fe1e6b3f/kube-rbac-proxy-web/0.log" Jun 13 05:29:36.420382 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:36.420362 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_827b9508-ff5d-4932-b55b-0236fe1e6b3f/kube-rbac-proxy/0.log" Jun 13 05:29:36.620488 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:36.620445 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_827b9508-ff5d-4932-b55b-0236fe1e6b3f/kube-rbac-proxy-thanos/0.log" Jun 13 05:29:37.219757 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:37.219737 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-2z7dg_ee08c043-6837-4e29-a4a6-8e9c4a5b4f38/prometheus-operator-admission-webhook/0.log" Jun 13 05:29:38.620229 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:38.620195 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-c5djt_61f9d614-9416-47f4-97a8-605c1e86b71e/networking-console-plugin/0.log" Jun 13 05:29:40.621572 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:40.621538 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w54d4_c8014faf-8210-422e-afed-a4af9eb97e04/dns/0.log" Jun 13 05:29:40.819605 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:40.819581 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w54d4_c8014faf-8210-422e-afed-a4af9eb97e04/kube-rbac-proxy/0.log" Jun 13 05:29:41.420198 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:41.420179 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xjvfv_8dddcf0a-2034-4b38-a5c5-4592132ddc8a/dns-node-resolver/0.log" Jun 13 05:29:41.620799 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:41.620769 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b4d6cd465-vk697_3fa0a34c-57db-4147-acca-f63c1ccdae56/registry/0.log" Jun 13 05:29:41.705503 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:41.705435 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:41.806544 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:41.806499 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:42.220337 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:42.220301 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b26pl_1b2682ad-26c1-430c-906c-87fd647f456f/node-ca/0.log" Jun 13 05:29:43.220094 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:43.220050 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7dl2d_6b76dae1-0c22-4a9d-a7ef-3868336a2e2a/serve-healthcheck-canary/0.log" Jun 13 05:29:43.533966 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:43.533927 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:43.636682 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:43.636642 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:45.773958 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:45.773912 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b4d6cd465-vk697"] Jun 13 05:29:45.802919 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:45.802874 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:45.901741 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:45.901710 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:45.949188 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:45.949158 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:46.432831 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:46.432794 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:46.866052 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:46.866023 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:29:46.866427 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:46.866326 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="alertmanager" containerID="cri-o://26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b" gracePeriod=120 Jun 13 05:29:46.866493 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:46.866432 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy-web" containerID="cri-o://81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562" gracePeriod=120 Jun 13 05:29:46.866493 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:46.866445 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="prom-label-proxy" containerID="cri-o://cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962" gracePeriod=120 Jun 13 05:29:46.866606 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:46.866445 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy" containerID="cri-o://342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f" gracePeriod=120 Jun 13 05:29:46.866606 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:46.866548 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="config-reloader" containerID="cri-o://3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474" gracePeriod=120 Jun 13 05:29:46.866729 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:46.866690 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy-metric" containerID="cri-o://131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1" gracePeriod=120 Jun 13 05:29:47.725858 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.725826 2584 generic.go:356] "Generic (PLEG): container finished" podID="414cd489-5395-4c0a-bf84-592406417696" containerID="cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962" exitCode=0 Jun 13 05:29:47.725858 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.725852 2584 generic.go:356] "Generic (PLEG): container finished" podID="414cd489-5395-4c0a-bf84-592406417696" containerID="131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1" exitCode=0 Jun 13 05:29:47.725858 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.725858 2584 generic.go:356] "Generic (PLEG): container finished" podID="414cd489-5395-4c0a-bf84-592406417696" containerID="342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f" exitCode=0 Jun 13 05:29:47.725858 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.725863 2584 generic.go:356] "Generic (PLEG): container finished" podID="414cd489-5395-4c0a-bf84-592406417696" containerID="3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474" exitCode=0 Jun 13 05:29:47.725858 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.725868 2584 generic.go:356] "Generic (PLEG): container finished" podID="414cd489-5395-4c0a-bf84-592406417696" containerID="26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b" exitCode=0 Jun 13 05:29:47.726146 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.725899 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerDied","Data":"cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962"} Jun 13 05:29:47.726146 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.725962 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerDied","Data":"131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1"} Jun 13 05:29:47.726146 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.725987 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerDied","Data":"342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f"} Jun 13 05:29:47.726146 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.726011 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerDied","Data":"3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474"} Jun 13 05:29:47.726146 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:47.726034 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerDied","Data":"26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b"} Jun 13 05:29:48.115575 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.115554 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.220536 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220511 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.220678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220548 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-metrics-client-ca\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.220678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220571 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gk77\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-kube-api-access-7gk77\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.220678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220591 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-metric\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.220678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220613 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-config-out\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.220678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220657 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-web-config\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.220678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220674 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-alertmanager-main-db\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.221016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220707 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-main-tls\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.221016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220737 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-alertmanager-trusted-ca-bundle\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.221016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220775 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-web\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.221016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220810 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-tls-assets\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.221016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220840 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-config-volume\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.221016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220866 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-cluster-tls-config\") pod \"414cd489-5395-4c0a-bf84-592406417696\" (UID: \"414cd489-5395-4c0a-bf84-592406417696\") " Jun 13 05:29:48.221016 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.220930 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:48.221461 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.221317 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:48.221831 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.221534 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:29:48.221831 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.221800 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.221831 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.221826 2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/414cd489-5395-4c0a-bf84-592406417696-metrics-client-ca\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.222023 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.221841 2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-alertmanager-main-db\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.223576 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.223548 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-config-out" (OuterVolumeSpecName: "config-out") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:29:48.224027 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.223988 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-kube-api-access-7gk77" (OuterVolumeSpecName: "kube-api-access-7gk77") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "kube-api-access-7gk77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:29:48.224236 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.224211 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:48.224804 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.224773 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:29:48.224899 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.224877 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:48.224962 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.224895 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:48.225165 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.225149 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-config-volume" (OuterVolumeSpecName: "config-volume") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:48.225701 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.225684 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:48.229054 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.228961 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:48.236334 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.236280 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-web-config" (OuterVolumeSpecName: "web-config") pod "414cd489-5395-4c0a-bf84-592406417696" (UID: "414cd489-5395-4c0a-bf84-592406417696"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:48.322240 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322217 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-web-config\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322321 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322245 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-main-tls\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322321 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322262 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322321 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322276 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-tls-assets\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322321 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322288 2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-config-volume\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322321 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322302 2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-cluster-tls-config\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322321 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322316 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322577 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322331 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gk77\" (UniqueName: \"kubernetes.io/projected/414cd489-5395-4c0a-bf84-592406417696-kube-api-access-7gk77\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322577 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322346 2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/414cd489-5395-4c0a-bf84-592406417696-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.322577 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.322359 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/414cd489-5395-4c0a-bf84-592406417696-config-out\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:48.732576 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.732550 2584 generic.go:356] "Generic (PLEG): container finished" podID="414cd489-5395-4c0a-bf84-592406417696" containerID="81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562" exitCode=0 Jun 13 05:29:48.732666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.732632 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.732725 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.732623 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerDied","Data":"81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562"} Jun 13 05:29:48.732798 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.732784 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"414cd489-5395-4c0a-bf84-592406417696","Type":"ContainerDied","Data":"4785edd755b84e399e9f120215e5390a4552de5f3f7d89e8a95b1d586f066ad0"} Jun 13 05:29:48.732863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.732851 2584 scope.go:117] "RemoveContainer" containerID="cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962" Jun 13 05:29:48.740687 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.740672 2584 scope.go:117] "RemoveContainer" containerID="131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1" Jun 13 05:29:48.747529 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.747511 2584 scope.go:117] "RemoveContainer" containerID="342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f" Jun 13 05:29:48.754209 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.754008 2584 scope.go:117] "RemoveContainer" containerID="81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562" Jun 13 05:29:48.755829 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.755807 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:29:48.761842 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.761218 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:29:48.765645 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.765630 2584 scope.go:117] "RemoveContainer" containerID="3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474" Jun 13 05:29:48.772120 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.772045 2584 scope.go:117] "RemoveContainer" containerID="26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b" Jun 13 05:29:48.779228 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.779213 2584 scope.go:117] "RemoveContainer" containerID="59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f" Jun 13 05:29:48.784660 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784635 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:29:48.784909 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784895 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="init-config-reloader" Jun 13 05:29:48.784909 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784909 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="init-config-reloader" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784921 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="alertmanager" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784926 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="alertmanager" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784934 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy-web" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784939 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy-web" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784953 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="config-reloader" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784958 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="config-reloader" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784965 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy-metric" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784970 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy-metric" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784978 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784983 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784991 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="prom-label-proxy" Jun 13 05:29:48.785001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.784995 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="prom-label-proxy" Jun 13 05:29:48.785368 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.785036 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="config-reloader" Jun 13 05:29:48.785368 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.785044 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="alertmanager" Jun 13 05:29:48.785368 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.785049 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="prom-label-proxy" Jun 13 05:29:48.785368 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.785054 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy-web" Jun 13 05:29:48.785368 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.785059 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy" Jun 13 05:29:48.785368 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.785065 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="414cd489-5395-4c0a-bf84-592406417696" containerName="kube-rbac-proxy-metric" Jun 13 05:29:48.786629 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.786614 2584 scope.go:117] "RemoveContainer" containerID="cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962" Jun 13 05:29:48.786865 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:48.786842 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962\": container with ID starting with cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962 not found: ID does not exist" containerID="cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962" Jun 13 05:29:48.786913 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.786873 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962"} err="failed to get container status \"cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962\": rpc error: code = NotFound desc = could not find container \"cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962\": container with ID starting with cb20fd1e3c83d80c50600720863f3246fffd288d8bf1d43fcc351f8d960af962 not found: ID does not exist" Jun 13 05:29:48.786913 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.786903 2584 scope.go:117] "RemoveContainer" containerID="131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1" Jun 13 05:29:48.787127 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:48.787109 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1\": container with ID starting with 131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1 not found: ID does not exist" containerID="131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1" Jun 13 05:29:48.787183 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.787131 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1"} err="failed to get container status \"131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1\": rpc error: code = NotFound desc = could not find container \"131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1\": container with ID starting with 131a209fb27cbc8075148caa89521376d2b5e9a242da388bb2de665a757991f1 not found: ID does not exist" Jun 13 05:29:48.787183 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.787144 2584 scope.go:117] "RemoveContainer" containerID="342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f" Jun 13 05:29:48.787400 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:48.787376 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f\": container with ID starting with 342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f not found: ID does not exist" containerID="342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f" Jun 13 05:29:48.787472 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.787402 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f"} err="failed to get container status \"342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f\": rpc error: code = NotFound desc = could not find container \"342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f\": container with ID starting with 342b270cb63fdad1f9e5ab6a18f370050b992b5684f916608e4e3724179abb1f not found: ID does not exist" Jun 13 05:29:48.787472 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.787420 2584 scope.go:117] "RemoveContainer" containerID="81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562" Jun 13 05:29:48.787645 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:48.787629 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562\": container with ID starting with 81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562 not found: ID does not exist" containerID="81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562" Jun 13 05:29:48.787683 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.787648 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562"} err="failed to get container status \"81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562\": rpc error: code = NotFound desc = could not find container \"81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562\": container with ID starting with 81a7598ca4081cc0e0e4d786681421ad3e776fbf11ebff912677add844624562 not found: ID does not exist" Jun 13 05:29:48.787683 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.787661 2584 scope.go:117] "RemoveContainer" containerID="3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474" Jun 13 05:29:48.787872 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:48.787857 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474\": container with ID starting with 3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474 not found: ID does not exist" containerID="3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474" Jun 13 05:29:48.787913 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.787875 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474"} err="failed to get container status \"3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474\": rpc error: code = NotFound desc = could not find container \"3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474\": container with ID starting with 3c3da05fa1536c3fcf21d81e9564946c5f82ea9dc70fe3ec14bb6f91f3228474 not found: ID does not exist" Jun 13 05:29:48.787913 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.787887 2584 scope.go:117] "RemoveContainer" containerID="26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b" Jun 13 05:29:48.788097 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:48.788059 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b\": container with ID starting with 26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b not found: ID does not exist" containerID="26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b" Jun 13 05:29:48.788141 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.788100 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b"} err="failed to get container status \"26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b\": rpc error: code = NotFound desc = could not find container \"26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b\": container with ID starting with 26be94e5f2e5aae52094935641eccbb2573f0a0b42db76d39a3f374d9147359b not found: ID does not exist" Jun 13 05:29:48.788141 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.788112 2584 scope.go:117] "RemoveContainer" containerID="59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f" Jun 13 05:29:48.788343 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:48.788325 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f\": container with ID starting with 59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f not found: ID does not exist" containerID="59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f" Jun 13 05:29:48.788390 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.788348 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f"} err="failed to get container status \"59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f\": rpc error: code = NotFound desc = could not find container \"59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f\": container with ID starting with 59ca493ea6766af5ee01df93d171fefe1a3aad70475d7a2d50cc6d7cfe67df8f not found: ID does not exist" Jun 13 05:29:48.790540 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.790518 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.793100 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793031 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 13 05:29:48.793100 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793053 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cfgd5\"" Jun 13 05:29:48.793100 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793057 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 13 05:29:48.793293 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793057 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 13 05:29:48.793293 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793200 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 13 05:29:48.793293 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793200 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 13 05:29:48.793293 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793224 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 13 05:29:48.793463 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793332 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 13 05:29:48.793463 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.793409 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 13 05:29:48.798216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.798199 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 13 05:29:48.801664 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.801645 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927620 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc3378ef-2553-4c91-b857-67b3951498f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927650 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3378ef-2553-4c91-b857-67b3951498f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927673 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-web-config\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927707 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927730 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc3378ef-2553-4c91-b857-67b3951498f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927746 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927777 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927818 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r9jb\" (UniqueName: \"kubernetes.io/projected/cc3378ef-2553-4c91-b857-67b3951498f6-kube-api-access-9r9jb\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927838 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927870 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc3378ef-2553-4c91-b857-67b3951498f6-config-out\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.927907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927890 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.928360 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927916 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc3378ef-2553-4c91-b857-67b3951498f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:48.928360 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:48.927964 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.028912 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.028888 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029005 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.028918 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r9jb\" (UniqueName: \"kubernetes.io/projected/cc3378ef-2553-4c91-b857-67b3951498f6-kube-api-access-9r9jb\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029005 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.028936 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029005 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.028970 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc3378ef-2553-4c91-b857-67b3951498f6-config-out\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029005 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.028995 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029204 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029030 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc3378ef-2553-4c91-b857-67b3951498f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029204 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029061 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029204 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029147 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc3378ef-2553-4c91-b857-67b3951498f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029347 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029275 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3378ef-2553-4c91-b857-67b3951498f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029347 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029311 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-web-config\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029455 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029342 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029455 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029371 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc3378ef-2553-4c91-b857-67b3951498f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029455 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029404 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.029455 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.029406 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cc3378ef-2553-4c91-b857-67b3951498f6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.030328 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.030304 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cc3378ef-2553-4c91-b857-67b3951498f6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.032030 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.031909 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cc3378ef-2553-4c91-b857-67b3951498f6-config-out\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.032446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.032138 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.032446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.032153 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.032446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.032238 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cc3378ef-2553-4c91-b857-67b3951498f6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.032446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.032261 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.032718 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.032517 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.032789 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.032768 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-config-volume\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.033014 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.032992 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc3378ef-2553-4c91-b857-67b3951498f6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.033164 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.033144 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.034279 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.034264 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cc3378ef-2553-4c91-b857-67b3951498f6-web-config\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.036553 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.036537 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r9jb\" (UniqueName: \"kubernetes.io/projected/cc3378ef-2553-4c91-b857-67b3951498f6-kube-api-access-9r9jb\") pod \"alertmanager-main-0\" (UID: \"cc3378ef-2553-4c91-b857-67b3951498f6\") " pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.100720 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.100693 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 13 05:29:49.235773 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.235725 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 13 05:29:49.238002 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:29:49.237974 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc3378ef_2553_4c91_b857_67b3951498f6.slice/crio-ec1686cd57bf6579db75e070800daecc9b3bd01748b859f62f8676cb7de7f46d WatchSource:0}: Error finding container ec1686cd57bf6579db75e070800daecc9b3bd01748b859f62f8676cb7de7f46d: Status 404 returned error can't find the container with id ec1686cd57bf6579db75e070800daecc9b3bd01748b859f62f8676cb7de7f46d Jun 13 05:29:49.488626 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.488601 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="414cd489-5395-4c0a-bf84-592406417696" path="/var/lib/kubelet/pods/414cd489-5395-4c0a-bf84-592406417696/volumes" Jun 13 05:29:49.738048 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.737991 2584 generic.go:356] "Generic (PLEG): container finished" podID="cc3378ef-2553-4c91-b857-67b3951498f6" containerID="03207550e45bfda8a62ef9190ac1af3ce68beb59bd1f765d47ded98821055f96" exitCode=0 Jun 13 05:29:49.738314 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.738042 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc3378ef-2553-4c91-b857-67b3951498f6","Type":"ContainerDied","Data":"03207550e45bfda8a62ef9190ac1af3ce68beb59bd1f765d47ded98821055f96"} Jun 13 05:29:49.738314 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:49.738142 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc3378ef-2553-4c91-b857-67b3951498f6","Type":"ContainerStarted","Data":"ec1686cd57bf6579db75e070800daecc9b3bd01748b859f62f8676cb7de7f46d"} Jun 13 05:29:50.723824 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.723794 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:50.745567 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.745546 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc3378ef-2553-4c91-b857-67b3951498f6","Type":"ContainerStarted","Data":"c6bb475a562eff5824389ed7e040a7a81590bbe33c7719bcd59d76e651e60c0b"} Jun 13 05:29:50.745666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.745601 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc3378ef-2553-4c91-b857-67b3951498f6","Type":"ContainerStarted","Data":"09ff03d87aa8f5fe80551d542e56e038934a5b9964fc245d57f574f22c625afc"} Jun 13 05:29:50.745666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.745626 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc3378ef-2553-4c91-b857-67b3951498f6","Type":"ContainerStarted","Data":"9a5a9ee3f45f6200ac2739bc65ad266c36d76cf51a1c911b7923c96aef98709c"} Jun 13 05:29:50.745666 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.745652 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc3378ef-2553-4c91-b857-67b3951498f6","Type":"ContainerStarted","Data":"e5582c92b1f97070bc9fabc6f2a8b3657c67cd9f2ef729b1fc93f9e4c77088cd"} Jun 13 05:29:50.745770 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.745675 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc3378ef-2553-4c91-b857-67b3951498f6","Type":"ContainerStarted","Data":"f3cde77f74043ebe45fd28e7d3ab38560dd9165479d033139ebfa95580a80698"} Jun 13 05:29:50.745770 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.745697 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cc3378ef-2553-4c91-b857-67b3951498f6","Type":"ContainerStarted","Data":"5187a27b57d3d4ea9ad80f53c6505601aecc63db6fc581cc13935c9c381b496d"} Jun 13 05:29:50.773972 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.773927 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.759619392 podStartE2EDuration="2.773914115s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.294723ms" isStatefulPod=false podCreationTimestamp="2026-06-13 05:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:29:50.771158262 +0000 UTC m=+325.751102154" watchObservedRunningTime="2026-06-13 05:29:50.773914115 +0000 UTC m=+325.753858006" Jun 13 05:29:50.785619 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.785592 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:50.888922 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.888898 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5f7b554d9-6whjq"] Jun 13 05:29:50.892463 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.892446 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:50.894657 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.894637 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 13 05:29:50.894770 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.894667 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-tt8gj\"" Jun 13 05:29:50.894888 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.894874 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 13 05:29:50.894939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.894881 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 13 05:29:50.894939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.894897 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 13 05:29:50.895204 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.895189 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 13 05:29:50.900149 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.900132 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 13 05:29:50.903606 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.903584 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f7b554d9-6whjq"] Jun 13 05:29:50.946322 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.946299 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-telemeter-client-tls\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:50.946403 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.946340 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-serving-certs-ca-bundle\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:50.946403 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.946359 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw745\" (UniqueName: \"kubernetes.io/projected/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-kube-api-access-cw745\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:50.946509 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.946438 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-secret-telemeter-client\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:50.946509 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.946482 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-metrics-client-ca\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:50.946577 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.946521 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-federate-client-tls\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:50.946577 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.946549 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:50.946646 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:50.946628 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.046928 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.046906 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047007 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.046943 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-telemeter-client-tls\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047007 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.046968 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-serving-certs-ca-bundle\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047117 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.047097 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw745\" (UniqueName: \"kubernetes.io/projected/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-kube-api-access-cw745\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047164 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.047135 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-secret-telemeter-client\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047211 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.047164 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-metrics-client-ca\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047211 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.047203 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-federate-client-tls\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.047227 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047676 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.047650 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-serving-certs-ca-bundle\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.047939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.047921 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.048038 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.048012 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-metrics-client-ca\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.049422 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.049404 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.049601 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.049583 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-telemeter-client-tls\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.049967 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.049949 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-secret-telemeter-client\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.050047 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.050026 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-federate-client-tls\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.054747 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.054726 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw745\" (UniqueName: \"kubernetes.io/projected/4dcc7533-7e0e-4f09-83e4-930ed58c0dca-kube-api-access-cw745\") pod \"telemeter-client-5f7b554d9-6whjq\" (UID: \"4dcc7533-7e0e-4f09-83e4-930ed58c0dca\") " pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.202012 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.201989 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" Jun 13 05:29:51.235330 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.235306 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:29:51.235702 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.235676 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="prometheus" containerID="cri-o://ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" gracePeriod=600 Jun 13 05:29:51.235749 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.235717 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" gracePeriod=600 Jun 13 05:29:51.235794 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.235746 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy-web" containerID="cri-o://17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" gracePeriod=600 Jun 13 05:29:51.235861 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.235844 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy" containerID="cri-o://d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" gracePeriod=600 Jun 13 05:29:51.235901 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.235856 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="config-reloader" containerID="cri-o://164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" gracePeriod=600 Jun 13 05:29:51.235949 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.235911 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="thanos-sidecar" containerID="cri-o://1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" gracePeriod=600 Jun 13 05:29:51.343116 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.343084 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5f7b554d9-6whjq"] Jun 13 05:29:51.353987 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:29:51.353966 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcc7533_7e0e_4f09_83e4_930ed58c0dca.slice/crio-6f0191d91ee63550a0e011102afee31b91e86a7945cba1904da8094f6eb38a3f WatchSource:0}: Error finding container 6f0191d91ee63550a0e011102afee31b91e86a7945cba1904da8094f6eb38a3f: Status 404 returned error can't find the container with id 6f0191d91ee63550a0e011102afee31b91e86a7945cba1904da8094f6eb38a3f Jun 13 05:29:51.355938 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.355921 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 05:29:51.462533 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.462496 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.551383 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551352 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-1\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551387 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-metrics-client-ca\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551408 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551427 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-kube-rbac-proxy\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551470 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-serving-certs-ca-bundle\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551499 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-tls\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551531 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-0\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551556 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config-out\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551581 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551608 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-thanos-prometheus-http-client-file\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551635 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-metrics-client-certs\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551668 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-web-config\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551700 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-grpc-tls\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551735 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:51.551771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551766 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-kubelet-serving-ca-bundle\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.552216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551802 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-2\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.552216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551836 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-db\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.552216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551865 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx89l\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-kube-api-access-hx89l\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.552216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551899 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-tls-assets\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.552216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551926 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.552216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.551954 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-trusted-ca-bundle\") pod \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\" (UID: \"827b9508-ff5d-4932-b55b-0236fe1e6b3f\") " Jun 13 05:29:51.552216 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.552147 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:51.552703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.552531 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.552703 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.552553 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-metrics-client-ca\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.553976 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.553208 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:51.554418 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.554294 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:51.554701 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.554571 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:51.554794 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.554764 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:51.555297 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.555272 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.555446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.555410 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:29:51.555841 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.555686 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config-out" (OuterVolumeSpecName: "config-out") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:29:51.555841 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.555697 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config" (OuterVolumeSpecName: "config") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.555841 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.555709 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.555841 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.555731 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:29:51.556156 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.555930 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.556331 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.556303 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.557048 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.557016 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.557165 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.557092 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-kube-api-access-hx89l" (OuterVolumeSpecName: "kube-api-access-hx89l") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "kube-api-access-hx89l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:29:51.557165 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.557135 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.557428 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.557410 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:29:51.557555 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.557536 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.566369 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.566345 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-web-config" (OuterVolumeSpecName: "web-config") pod "827b9508-ff5d-4932-b55b-0236fe1e6b3f" (UID: "827b9508-ff5d-4932-b55b-0236fe1e6b3f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:29:51.653439 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653385 2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653439 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653404 2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-kube-rbac-proxy\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653439 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653415 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653439 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653424 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653439 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653433 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653439 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653440 2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-config-out\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653448 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653457 2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653467 2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-metrics-client-certs\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653475 2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-web-config\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653482 2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-grpc-tls\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653489 2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653497 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653504 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-k8s-db\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653512 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx89l\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-kube-api-access-hx89l\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653520 2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/827b9508-ff5d-4932-b55b-0236fe1e6b3f-tls-assets\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653528 2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/827b9508-ff5d-4932-b55b-0236fe1e6b3f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.653679 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.653535 2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/827b9508-ff5d-4932-b55b-0236fe1e6b3f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:29:51.751359 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.751333 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" event={"ID":"4dcc7533-7e0e-4f09-83e4-930ed58c0dca","Type":"ContainerStarted","Data":"6f0191d91ee63550a0e011102afee31b91e86a7945cba1904da8094f6eb38a3f"} Jun 13 05:29:51.754288 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754269 2584 generic.go:356] "Generic (PLEG): container finished" podID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" exitCode=0 Jun 13 05:29:51.754288 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754289 2584 generic.go:356] "Generic (PLEG): container finished" podID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" exitCode=0 Jun 13 05:29:51.754380 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754295 2584 generic.go:356] "Generic (PLEG): container finished" podID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" exitCode=0 Jun 13 05:29:51.754380 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754301 2584 generic.go:356] "Generic (PLEG): container finished" podID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" exitCode=0 Jun 13 05:29:51.754380 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754306 2584 generic.go:356] "Generic (PLEG): container finished" podID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" exitCode=0 Jun 13 05:29:51.754380 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754311 2584 generic.go:356] "Generic (PLEG): container finished" podID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" exitCode=0 Jun 13 05:29:51.754380 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754351 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.754516 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754346 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerDied","Data":"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5"} Jun 13 05:29:51.754516 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754474 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerDied","Data":"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f"} Jun 13 05:29:51.754516 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754501 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerDied","Data":"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c"} Jun 13 05:29:51.754609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754531 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerDied","Data":"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111"} Jun 13 05:29:51.754609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754546 2584 scope.go:117] "RemoveContainer" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" Jun 13 05:29:51.754609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754556 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerDied","Data":"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d"} Jun 13 05:29:51.754609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754579 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerDied","Data":"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e"} Jun 13 05:29:51.754609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.754602 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"827b9508-ff5d-4932-b55b-0236fe1e6b3f","Type":"ContainerDied","Data":"8465406a2d260749c0a3c8157e9a15cccf4fcb384ecd37e783a5a1c8e2ea8576"} Jun 13 05:29:51.764505 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.764485 2584 scope.go:117] "RemoveContainer" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" Jun 13 05:29:51.771457 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.771439 2584 scope.go:117] "RemoveContainer" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" Jun 13 05:29:51.778201 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.778135 2584 scope.go:117] "RemoveContainer" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" Jun 13 05:29:51.778280 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.778260 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:29:51.782698 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.782678 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:29:51.785379 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.785366 2584 scope.go:117] "RemoveContainer" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" Jun 13 05:29:51.791712 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.791698 2584 scope.go:117] "RemoveContainer" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" Jun 13 05:29:51.798734 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.798716 2584 scope.go:117] "RemoveContainer" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" Jun 13 05:29:51.805804 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.805786 2584 scope.go:117] "RemoveContainer" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" Jun 13 05:29:51.806084 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:51.806046 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": container with ID starting with 557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5 not found: ID does not exist" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" Jun 13 05:29:51.806167 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806089 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5"} err="failed to get container status \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": rpc error: code = NotFound desc = could not find container \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": container with ID starting with 557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5 not found: ID does not exist" Jun 13 05:29:51.806167 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806106 2584 scope.go:117] "RemoveContainer" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" Jun 13 05:29:51.806263 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806241 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:29:51.806319 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:51.806302 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": container with ID starting with d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f not found: ID does not exist" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" Jun 13 05:29:51.806355 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806325 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f"} err="failed to get container status \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": rpc error: code = NotFound desc = could not find container \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": container with ID starting with d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f not found: ID does not exist" Jun 13 05:29:51.806355 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806338 2584 scope.go:117] "RemoveContainer" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" Jun 13 05:29:51.806545 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:51.806519 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": container with ID starting with 17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c not found: ID does not exist" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" Jun 13 05:29:51.806585 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806551 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="init-config-reloader" Jun 13 05:29:51.806585 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806564 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="init-config-reloader" Jun 13 05:29:51.806585 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806577 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="prometheus" Jun 13 05:29:51.806585 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806582 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="prometheus" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806588 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806593 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806601 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="thanos-sidecar" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806606 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="thanos-sidecar" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806613 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy-thanos" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806619 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy-thanos" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806627 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy-web" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806632 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy-web" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806550 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c"} err="failed to get container status \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": rpc error: code = NotFound desc = could not find container \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": container with ID starting with 17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c not found: ID does not exist" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806647 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="config-reloader" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806658 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="config-reloader" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806645 2584 scope.go:117] "RemoveContainer" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" Jun 13 05:29:51.806711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806713 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="prometheus" Jun 13 05:29:51.807205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806723 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="config-reloader" Jun 13 05:29:51.807205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806732 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy-web" Jun 13 05:29:51.807205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806740 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy" Jun 13 05:29:51.807205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806749 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="kube-rbac-proxy-thanos" Jun 13 05:29:51.807205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806757 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" containerName="thanos-sidecar" Jun 13 05:29:51.807205 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:51.806932 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": container with ID starting with 1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111 not found: ID does not exist" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" Jun 13 05:29:51.807205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806956 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111"} err="failed to get container status \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": rpc error: code = NotFound desc = could not find container \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": container with ID starting with 1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111 not found: ID does not exist" Jun 13 05:29:51.807205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.806974 2584 scope.go:117] "RemoveContainer" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" Jun 13 05:29:51.807471 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:51.807208 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": container with ID starting with 164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d not found: ID does not exist" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" Jun 13 05:29:51.807471 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.807230 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d"} err="failed to get container status \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": rpc error: code = NotFound desc = could not find container \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": container with ID starting with 164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d not found: ID does not exist" Jun 13 05:29:51.807471 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.807242 2584 scope.go:117] "RemoveContainer" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" Jun 13 05:29:51.807605 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:51.807481 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": container with ID starting with ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e not found: ID does not exist" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" Jun 13 05:29:51.807605 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.807511 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e"} err="failed to get container status \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": rpc error: code = NotFound desc = could not find container \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": container with ID starting with ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e not found: ID does not exist" Jun 13 05:29:51.807605 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.807535 2584 scope.go:117] "RemoveContainer" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" Jun 13 05:29:51.807795 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:29:51.807776 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": container with ID starting with 002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6 not found: ID does not exist" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" Jun 13 05:29:51.807841 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.807799 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6"} err="failed to get container status \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": rpc error: code = NotFound desc = could not find container \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": container with ID starting with 002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6 not found: ID does not exist" Jun 13 05:29:51.807841 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.807813 2584 scope.go:117] "RemoveContainer" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" Jun 13 05:29:51.808161 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.808137 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5"} err="failed to get container status \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": rpc error: code = NotFound desc = could not find container \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": container with ID starting with 557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5 not found: ID does not exist" Jun 13 05:29:51.808245 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.808162 2584 scope.go:117] "RemoveContainer" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" Jun 13 05:29:51.808514 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.808495 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f"} err="failed to get container status \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": rpc error: code = NotFound desc = could not find container \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": container with ID starting with d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f not found: ID does not exist" Jun 13 05:29:51.808580 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.808516 2584 scope.go:117] "RemoveContainer" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" Jun 13 05:29:51.808748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.808727 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c"} err="failed to get container status \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": rpc error: code = NotFound desc = could not find container \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": container with ID starting with 17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c not found: ID does not exist" Jun 13 05:29:51.808799 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.808749 2584 scope.go:117] "RemoveContainer" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" Jun 13 05:29:51.808957 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.808942 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111"} err="failed to get container status \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": rpc error: code = NotFound desc = could not find container \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": container with ID starting with 1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111 not found: ID does not exist" Jun 13 05:29:51.808999 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.808957 2584 scope.go:117] "RemoveContainer" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" Jun 13 05:29:51.809204 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809184 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d"} err="failed to get container status \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": rpc error: code = NotFound desc = could not find container \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": container with ID starting with 164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d not found: ID does not exist" Jun 13 05:29:51.809204 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809204 2584 scope.go:117] "RemoveContainer" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" Jun 13 05:29:51.809429 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809410 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e"} err="failed to get container status \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": rpc error: code = NotFound desc = could not find container \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": container with ID starting with ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e not found: ID does not exist" Jun 13 05:29:51.809483 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809429 2584 scope.go:117] "RemoveContainer" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" Jun 13 05:29:51.809614 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809599 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6"} err="failed to get container status \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": rpc error: code = NotFound desc = could not find container \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": container with ID starting with 002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6 not found: ID does not exist" Jun 13 05:29:51.809663 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809614 2584 scope.go:117] "RemoveContainer" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" Jun 13 05:29:51.809830 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809814 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5"} err="failed to get container status \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": rpc error: code = NotFound desc = could not find container \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": container with ID starting with 557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5 not found: ID does not exist" Jun 13 05:29:51.809874 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809830 2584 scope.go:117] "RemoveContainer" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" Jun 13 05:29:51.810003 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.809986 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f"} err="failed to get container status \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": rpc error: code = NotFound desc = could not find container \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": container with ID starting with d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f not found: ID does not exist" Jun 13 05:29:51.810049 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810004 2584 scope.go:117] "RemoveContainer" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" Jun 13 05:29:51.810234 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810217 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c"} err="failed to get container status \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": rpc error: code = NotFound desc = could not find container \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": container with ID starting with 17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c not found: ID does not exist" Jun 13 05:29:51.810275 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810235 2584 scope.go:117] "RemoveContainer" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" Jun 13 05:29:51.810450 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810433 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111"} err="failed to get container status \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": rpc error: code = NotFound desc = could not find container \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": container with ID starting with 1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111 not found: ID does not exist" Jun 13 05:29:51.810487 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810450 2584 scope.go:117] "RemoveContainer" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" Jun 13 05:29:51.810652 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810635 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d"} err="failed to get container status \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": rpc error: code = NotFound desc = could not find container \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": container with ID starting with 164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d not found: ID does not exist" Jun 13 05:29:51.810693 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810652 2584 scope.go:117] "RemoveContainer" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" Jun 13 05:29:51.810845 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810827 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e"} err="failed to get container status \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": rpc error: code = NotFound desc = could not find container \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": container with ID starting with ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e not found: ID does not exist" Jun 13 05:29:51.810881 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810846 2584 scope.go:117] "RemoveContainer" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" Jun 13 05:29:51.811014 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.810999 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6"} err="failed to get container status \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": rpc error: code = NotFound desc = could not find container \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": container with ID starting with 002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6 not found: ID does not exist" Jun 13 05:29:51.811014 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811013 2584 scope.go:117] "RemoveContainer" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" Jun 13 05:29:51.811201 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811183 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5"} err="failed to get container status \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": rpc error: code = NotFound desc = could not find container \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": container with ID starting with 557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5 not found: ID does not exist" Jun 13 05:29:51.811249 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811202 2584 scope.go:117] "RemoveContainer" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" Jun 13 05:29:51.811399 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811384 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f"} err="failed to get container status \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": rpc error: code = NotFound desc = could not find container \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": container with ID starting with d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f not found: ID does not exist" Jun 13 05:29:51.811437 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811399 2584 scope.go:117] "RemoveContainer" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" Jun 13 05:29:51.811607 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811589 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c"} err="failed to get container status \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": rpc error: code = NotFound desc = could not find container \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": container with ID starting with 17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c not found: ID does not exist" Jun 13 05:29:51.811607 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811607 2584 scope.go:117] "RemoveContainer" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" Jun 13 05:29:51.811794 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811778 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111"} err="failed to get container status \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": rpc error: code = NotFound desc = could not find container \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": container with ID starting with 1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111 not found: ID does not exist" Jun 13 05:29:51.811845 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.811794 2584 scope.go:117] "RemoveContainer" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" Jun 13 05:29:51.812043 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.812026 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d"} err="failed to get container status \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": rpc error: code = NotFound desc = could not find container \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": container with ID starting with 164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d not found: ID does not exist" Jun 13 05:29:51.812043 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.812043 2584 scope.go:117] "RemoveContainer" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" Jun 13 05:29:51.812229 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.812124 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.812356 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.812321 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e"} err="failed to get container status \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": rpc error: code = NotFound desc = could not find container \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": container with ID starting with ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e not found: ID does not exist" Jun 13 05:29:51.812418 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.812358 2584 scope.go:117] "RemoveContainer" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" Jun 13 05:29:51.812710 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.812683 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6"} err="failed to get container status \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": rpc error: code = NotFound desc = could not find container \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": container with ID starting with 002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6 not found: ID does not exist" Jun 13 05:29:51.812790 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.812711 2584 scope.go:117] "RemoveContainer" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" Jun 13 05:29:51.813000 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.812972 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5"} err="failed to get container status \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": rpc error: code = NotFound desc = could not find container \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": container with ID starting with 557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5 not found: ID does not exist" Jun 13 05:29:51.813091 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813000 2584 scope.go:117] "RemoveContainer" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" Jun 13 05:29:51.813266 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813245 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f"} err="failed to get container status \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": rpc error: code = NotFound desc = could not find container \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": container with ID starting with d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f not found: ID does not exist" Jun 13 05:29:51.813339 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813270 2584 scope.go:117] "RemoveContainer" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" Jun 13 05:29:51.813457 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813442 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c"} err="failed to get container status \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": rpc error: code = NotFound desc = could not find container \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": container with ID starting with 17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c not found: ID does not exist" Jun 13 05:29:51.813510 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813457 2584 scope.go:117] "RemoveContainer" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" Jun 13 05:29:51.813661 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813644 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111"} err="failed to get container status \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": rpc error: code = NotFound desc = could not find container \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": container with ID starting with 1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111 not found: ID does not exist" Jun 13 05:29:51.813709 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813663 2584 scope.go:117] "RemoveContainer" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" Jun 13 05:29:51.813882 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813860 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d"} err="failed to get container status \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": rpc error: code = NotFound desc = could not find container \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": container with ID starting with 164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d not found: ID does not exist" Jun 13 05:29:51.813927 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.813885 2584 scope.go:117] "RemoveContainer" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" Jun 13 05:29:51.814165 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814144 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e"} err="failed to get container status \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": rpc error: code = NotFound desc = could not find container \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": container with ID starting with ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e not found: ID does not exist" Jun 13 05:29:51.814228 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814187 2584 scope.go:117] "RemoveContainer" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" Jun 13 05:29:51.814332 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814311 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 13 05:29:51.814497 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814476 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6"} err="failed to get container status \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": rpc error: code = NotFound desc = could not find container \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": container with ID starting with 002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6 not found: ID does not exist" Jun 13 05:29:51.814584 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814499 2584 scope.go:117] "RemoveContainer" containerID="557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5" Jun 13 05:29:51.814584 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814509 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 13 05:29:51.814584 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814549 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 13 05:29:51.814747 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814613 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 13 05:29:51.814747 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814628 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 13 05:29:51.814843 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814753 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5"} err="failed to get container status \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": rpc error: code = NotFound desc = could not find container \"557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5\": container with ID starting with 557702d03d398ecbe51ccee519bc4e3879c527c7db9e543e9175f50b775fced5 not found: ID does not exist" Jun 13 05:29:51.814843 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814767 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 13 05:29:51.814843 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814792 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 13 05:29:51.814843 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814835 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 13 05:29:51.815032 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814770 2584 scope.go:117] "RemoveContainer" containerID="d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f" Jun 13 05:29:51.815032 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814835 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 13 05:29:51.815032 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.814880 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-35idkr1q95mlb\"" Jun 13 05:29:51.815193 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815041 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 13 05:29:51.815193 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815115 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f"} err="failed to get container status \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": rpc error: code = NotFound desc = could not find container \"d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f\": container with ID starting with d2869741445801d3266429d0296493ba67acf134e307e834b29e82a5ab4cb81f not found: ID does not exist" Jun 13 05:29:51.815193 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815136 2584 scope.go:117] "RemoveContainer" containerID="17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c" Jun 13 05:29:51.815398 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815373 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c"} err="failed to get container status \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": rpc error: code = NotFound desc = could not find container \"17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c\": container with ID starting with 17549ba764234acaba40d8cd9e69f0c968598e7b52e2e1c0cfec59787087ab8c not found: ID does not exist" Jun 13 05:29:51.815462 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815400 2584 scope.go:117] "RemoveContainer" containerID="1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111" Jun 13 05:29:51.815517 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815490 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 13 05:29:51.815665 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815638 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b5jss\"" Jun 13 05:29:51.815759 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815669 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111"} err="failed to get container status \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": rpc error: code = NotFound desc = could not find container \"1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111\": container with ID starting with 1835eaf05f7c2b37c218306bcd06cb1b6183d1ffd579b08798a19ac8606a2111 not found: ID does not exist" Jun 13 05:29:51.815759 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815689 2584 scope.go:117] "RemoveContainer" containerID="164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d" Jun 13 05:29:51.815759 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815713 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 13 05:29:51.815946 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815931 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 13 05:29:51.815990 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815951 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d"} err="failed to get container status \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": rpc error: code = NotFound desc = could not find container \"164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d\": container with ID starting with 164bf6a9bf1e226d1985a542dc751cbc7547f346338300148dd2d677a829f39d not found: ID does not exist" Jun 13 05:29:51.815990 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.815972 2584 scope.go:117] "RemoveContainer" containerID="ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e" Jun 13 05:29:51.816288 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.816261 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e"} err="failed to get container status \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": rpc error: code = NotFound desc = could not find container \"ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e\": container with ID starting with ee940a2882a49727d38e31de0016aa8a78880009b8bb30b8bbc16f19e664514e not found: ID does not exist" Jun 13 05:29:51.816379 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.816290 2584 scope.go:117] "RemoveContainer" containerID="002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6" Jun 13 05:29:51.816581 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.816531 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6"} err="failed to get container status \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": rpc error: code = NotFound desc = could not find container \"002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6\": container with ID starting with 002221ce5d47f00b12fcc7f5983473875ad15aa1fb767cb3e28ded25dcc5f9d6 not found: ID does not exist" Jun 13 05:29:51.817668 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.817649 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 13 05:29:51.820444 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.820423 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 13 05:29:51.823960 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.823942 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:29:51.956266 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956205 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7af68aae-5e34-463f-b210-c59f06f9ef08-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956266 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956240 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956266 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956261 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956441 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956334 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956441 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956366 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trkp\" (UniqueName: \"kubernetes.io/projected/7af68aae-5e34-463f-b210-c59f06f9ef08-kube-api-access-2trkp\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956441 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956410 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956441 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956464 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956492 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956515 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7af68aae-5e34-463f-b210-c59f06f9ef08-config-out\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956638 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956529 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956638 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956551 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956638 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956576 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-web-config\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956638 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956599 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956638 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956617 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956638 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956632 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956837 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956658 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956837 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956690 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956837 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956720 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:51.956837 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:51.956744 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-config\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.057685 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.057660 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.057772 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.057704 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.057772 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.057731 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.057772 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.057758 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058509 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058259 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7af68aae-5e34-463f-b210-c59f06f9ef08-config-out\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058509 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058294 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058509 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058321 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058509 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058344 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-web-config\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058509 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058370 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058509 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058411 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058516 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058590 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058620 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058649 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058678 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058715 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-config\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058741 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7af68aae-5e34-463f-b210-c59f06f9ef08-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058777 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.058844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058808 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.059346 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058849 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.059346 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058891 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2trkp\" (UniqueName: \"kubernetes.io/projected/7af68aae-5e34-463f-b210-c59f06f9ef08-kube-api-access-2trkp\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.059346 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.058978 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.060712 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.059744 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.060712 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.060151 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.060712 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.060439 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.062161 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.060947 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.062161 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.061402 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.062161 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.061882 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.063980 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.063408 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-config\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.063980 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.063527 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7af68aae-5e34-463f-b210-c59f06f9ef08-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.063980 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.063660 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.064671 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.064649 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.065827 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.065792 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7af68aae-5e34-463f-b210-c59f06f9ef08-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.066865 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.066117 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.067728 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.067165 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7af68aae-5e34-463f-b210-c59f06f9ef08-config-out\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.067728 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.067404 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:52.067728 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.067684 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.067906 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.067730 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.067985 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.067965 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trkp\" (UniqueName: \"kubernetes.io/projected/7af68aae-5e34-463f-b210-c59f06f9ef08-kube-api-access-2trkp\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.068533 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.068494 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-web-config\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.068644 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.068624 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7af68aae-5e34-463f-b210-c59f06f9ef08-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7af68aae-5e34-463f-b210-c59f06f9ef08\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.118565 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.118492 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:52.122149 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.122132 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:29:52.286277 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.286247 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 13 05:29:52.288066 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:29:52.288035 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7af68aae_5e34_463f_b210_c59f06f9ef08.slice/crio-33644afdff9a4e7bd77a099040e6bb6a81c337672f5a541fdccccff066abaed3 WatchSource:0}: Error finding container 33644afdff9a4e7bd77a099040e6bb6a81c337672f5a541fdccccff066abaed3: Status 404 returned error can't find the container with id 33644afdff9a4e7bd77a099040e6bb6a81c337672f5a541fdccccff066abaed3 Jun 13 05:29:52.760569 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.760538 2584 generic.go:356] "Generic (PLEG): container finished" podID="7af68aae-5e34-463f-b210-c59f06f9ef08" containerID="0fdbdd753e56c7a4fe0a1fa4c08d5d757366025e9a4875c00116a65b4be8f7d4" exitCode=0 Jun 13 05:29:52.760929 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.760595 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7af68aae-5e34-463f-b210-c59f06f9ef08","Type":"ContainerDied","Data":"0fdbdd753e56c7a4fe0a1fa4c08d5d757366025e9a4875c00116a65b4be8f7d4"} Jun 13 05:29:52.760929 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:52.760676 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7af68aae-5e34-463f-b210-c59f06f9ef08","Type":"ContainerStarted","Data":"33644afdff9a4e7bd77a099040e6bb6a81c337672f5a541fdccccff066abaed3"} Jun 13 05:29:53.484194 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.484169 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="827b9508-ff5d-4932-b55b-0236fe1e6b3f" path="/var/lib/kubelet/pods/827b9508-ff5d-4932-b55b-0236fe1e6b3f/volumes" Jun 13 05:29:53.768575 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.768517 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7af68aae-5e34-463f-b210-c59f06f9ef08","Type":"ContainerStarted","Data":"89427b4514ec08b615a63e44822e7c68fa719a7f74764ca6990ebd1e7b2dca92"} Jun 13 05:29:53.768901 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.768583 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7af68aae-5e34-463f-b210-c59f06f9ef08","Type":"ContainerStarted","Data":"4ce97cfc470a7d8ee1830201909132faa0967ade594c8e74f0f9a8aecb8cbf7e"} Jun 13 05:29:53.768901 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.768623 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7af68aae-5e34-463f-b210-c59f06f9ef08","Type":"ContainerStarted","Data":"6dd9e0355ed109c992aa37ddc286b423c3eb6e6d3729b9c917971c847f39712a"} Jun 13 05:29:53.768901 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.768661 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7af68aae-5e34-463f-b210-c59f06f9ef08","Type":"ContainerStarted","Data":"47170831fac7b145ab6bfcdb0dae4cf268404fc6257ed40a0e131ffdc4e3fb05"} Jun 13 05:29:53.768901 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.768684 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7af68aae-5e34-463f-b210-c59f06f9ef08","Type":"ContainerStarted","Data":"3a42bdf9363c0a5e0d3b9dd3a8db5086fa523659fda2165d6ef32d0e67d94688"} Jun 13 05:29:53.768901 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.768708 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7af68aae-5e34-463f-b210-c59f06f9ef08","Type":"ContainerStarted","Data":"18b23f3eea810a8c315106ad0e23bfb826cbd7ba6a3172a6cd08a1a27c1449d2"} Jun 13 05:29:53.770534 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.770502 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" event={"ID":"4dcc7533-7e0e-4f09-83e4-930ed58c0dca","Type":"ContainerStarted","Data":"02393130127cc62eca2b368b4d85b8e0061541badffc25ba1d99bfbd10c974e9"} Jun 13 05:29:53.770645 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.770557 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" event={"ID":"4dcc7533-7e0e-4f09-83e4-930ed58c0dca","Type":"ContainerStarted","Data":"ae0a30ac53208ef4491bbe6550f65dafcf1317540dc1e74cae68f7cc463b25d4"} Jun 13 05:29:53.770645 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.770578 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" event={"ID":"4dcc7533-7e0e-4f09-83e4-930ed58c0dca","Type":"ContainerStarted","Data":"f62afb23b979179f53148ecdc7998d929fd0b2daf9e424fc5971c75461fb93aa"} Jun 13 05:29:53.795759 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.795715 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7753540340000002 podStartE2EDuration="2.795700162s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.346128ms" isStatefulPod=false podCreationTimestamp="2026-06-13 05:29:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:29:53.793607129 +0000 UTC m=+328.773551039" watchObservedRunningTime="2026-06-13 05:29:53.795700162 +0000 UTC m=+328.775644054" Jun 13 05:29:53.813876 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:53.813838 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5f7b554d9-6whjq" podStartSLOduration=2.04661253 podStartE2EDuration="3.813825886s" totalImagesPullingTime="1.767213356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:29:53.811713172 +0000 UTC m=+328.791657084" watchObservedRunningTime="2026-06-13 05:29:53.813825886 +0000 UTC m=+328.793769778" Jun 13 05:29:54.009829 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:54.009805 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:54.110738 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:54.110699 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:54.210752 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:54.210718 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:54.528616 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:54.528583 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:54.578853 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:54.578826 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:29:57.122818 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:29:57.122790 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:30:05.919194 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:05.919152 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:30:05.972388 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:05.972357 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:30:06.026007 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:06.025973 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:30:07.069337 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:07.069304 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:30:07.165535 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:07.165510 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:30:10.798357 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:10.798309 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" podUID="3fa0a34c-57db-4147-acca-f63c1ccdae56" containerName="registry" containerID="cri-o://2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118" gracePeriod=30 Jun 13 05:30:11.046152 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.046130 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:30:11.208137 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208061 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-certificates\") pod \"3fa0a34c-57db-4147-acca-f63c1ccdae56\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " Jun 13 05:30:11.208137 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208117 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-trusted-ca\") pod \"3fa0a34c-57db-4147-acca-f63c1ccdae56\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " Jun 13 05:30:11.208297 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208149 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v62cj\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-kube-api-access-v62cj\") pod \"3fa0a34c-57db-4147-acca-f63c1ccdae56\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " Jun 13 05:30:11.208297 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208253 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fa0a34c-57db-4147-acca-f63c1ccdae56-ca-trust-extracted\") pod \"3fa0a34c-57db-4147-acca-f63c1ccdae56\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " Jun 13 05:30:11.208402 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208324 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-image-registry-private-configuration\") pod \"3fa0a34c-57db-4147-acca-f63c1ccdae56\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " Jun 13 05:30:11.208402 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208353 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") pod \"3fa0a34c-57db-4147-acca-f63c1ccdae56\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " Jun 13 05:30:11.208402 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208377 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-bound-sa-token\") pod \"3fa0a34c-57db-4147-acca-f63c1ccdae56\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " Jun 13 05:30:11.208540 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208402 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-installation-pull-secrets\") pod \"3fa0a34c-57db-4147-acca-f63c1ccdae56\" (UID: \"3fa0a34c-57db-4147-acca-f63c1ccdae56\") " Jun 13 05:30:11.208540 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208507 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3fa0a34c-57db-4147-acca-f63c1ccdae56" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:30:11.208634 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208577 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3fa0a34c-57db-4147-acca-f63c1ccdae56" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 13 05:30:11.208695 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208671 2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-certificates\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:30:11.208695 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.208688 2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3fa0a34c-57db-4147-acca-f63c1ccdae56-trusted-ca\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:30:11.210891 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.210864 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3fa0a34c-57db-4147-acca-f63c1ccdae56" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:30:11.210993 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.210966 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3fa0a34c-57db-4147-acca-f63c1ccdae56" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:30:11.211048 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.211018 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3fa0a34c-57db-4147-acca-f63c1ccdae56" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:30:11.211117 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.211054 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-kube-api-access-v62cj" (OuterVolumeSpecName: "kube-api-access-v62cj") pod "3fa0a34c-57db-4147-acca-f63c1ccdae56" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56"). InnerVolumeSpecName "kube-api-access-v62cj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:30:11.211261 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.211244 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3fa0a34c-57db-4147-acca-f63c1ccdae56" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:30:11.216859 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.216834 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fa0a34c-57db-4147-acca-f63c1ccdae56-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3fa0a34c-57db-4147-acca-f63c1ccdae56" (UID: "3fa0a34c-57db-4147-acca-f63c1ccdae56"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 13 05:30:11.309335 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.309314 2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-bound-sa-token\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:30:11.309335 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.309334 2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-installation-pull-secrets\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:30:11.309442 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.309344 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v62cj\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-kube-api-access-v62cj\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:30:11.309442 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.309353 2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3fa0a34c-57db-4147-acca-f63c1ccdae56-ca-trust-extracted\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:30:11.309442 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.309363 2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3fa0a34c-57db-4147-acca-f63c1ccdae56-image-registry-private-configuration\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:30:11.309442 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.309373 2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3fa0a34c-57db-4147-acca-f63c1ccdae56-registry-tls\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:30:11.839706 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.839685 2584 generic.go:356] "Generic (PLEG): container finished" podID="3fa0a34c-57db-4147-acca-f63c1ccdae56" containerID="2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118" exitCode=0 Jun 13 05:30:11.839961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.839722 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" Jun 13 05:30:11.839961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.839775 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" event={"ID":"3fa0a34c-57db-4147-acca-f63c1ccdae56","Type":"ContainerDied","Data":"2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118"} Jun 13 05:30:11.839961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.839820 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b4d6cd465-vk697" event={"ID":"3fa0a34c-57db-4147-acca-f63c1ccdae56","Type":"ContainerDied","Data":"30a29c0412c733fda3f48c5f96044d3ddf4ce23a9350a2e579f673fb83490ec2"} Jun 13 05:30:11.839961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.839842 2584 scope.go:117] "RemoveContainer" containerID="2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118" Jun 13 05:30:11.847908 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.847893 2584 scope.go:117] "RemoveContainer" containerID="2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118" Jun 13 05:30:11.848181 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:30:11.848161 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118\": container with ID starting with 2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118 not found: ID does not exist" containerID="2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118" Jun 13 05:30:11.848231 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.848188 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118"} err="failed to get container status \"2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118\": rpc error: code = NotFound desc = could not find container \"2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118\": container with ID starting with 2fd1ff7225a98bdebea6a482d69949e4a7ff230cb08b879c6849071819b04118 not found: ID does not exist" Jun 13 05:30:11.855866 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.855844 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5b4d6cd465-vk697"] Jun 13 05:30:11.859396 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:11.859378 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5b4d6cd465-vk697"] Jun 13 05:30:13.488106 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:13.488059 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fa0a34c-57db-4147-acca-f63c1ccdae56" path="/var/lib/kubelet/pods/3fa0a34c-57db-4147-acca-f63c1ccdae56/volumes" Jun 13 05:30:52.123271 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:52.123240 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:30:52.138665 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:52.138643 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:30:53.018044 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:53.018022 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 13 05:30:58.389610 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:58.389573 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:30:58.438133 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:30:58.438101 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:01.024680 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:01.024646 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:01.072861 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:01.072830 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:03.279055 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:03.279022 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:12.850824 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:12.850787 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:12.951539 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:12.951515 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:14.165659 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:14.165632 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:14.265763 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:14.265736 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:22.070493 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:22.070461 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:22.169708 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:22.169680 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:37.172217 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:37.172186 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:31:37.265222 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:31:37.265184 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:03.742363 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:03.742280 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:04.486653 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:04.486613 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:04.571406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:04.571368 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:07.308895 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:07.308861 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:07.409633 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:07.409600 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:08.630822 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:08.630781 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:08.774442 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:08.774403 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:08.876047 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:08.876017 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:12.191160 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:12.191125 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:12.237467 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:12.237438 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:12.584898 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:12.584857 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:14.092924 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:14.092879 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:14.193327 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:14.193293 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:16.377379 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.377343 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-snvrc"] Jun 13 05:32:16.377737 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.377719 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fa0a34c-57db-4147-acca-f63c1ccdae56" containerName="registry" Jun 13 05:32:16.377737 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.377731 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fa0a34c-57db-4147-acca-f63c1ccdae56" containerName="registry" Jun 13 05:32:16.377810 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.377793 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fa0a34c-57db-4147-acca-f63c1ccdae56" containerName="registry" Jun 13 05:32:16.380416 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.380398 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" Jun 13 05:32:16.382950 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.382921 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 13 05:32:16.383094 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.382979 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 13 05:32:16.383992 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.383975 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fmfwp\"" Jun 13 05:32:16.388447 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.388423 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-snvrc"] Jun 13 05:32:16.434780 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.434749 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qth8w\" (UniqueName: \"kubernetes.io/projected/0093ceef-5e33-4b4e-b33f-bde7e8c5e3df-kube-api-access-qth8w\") pod \"cert-manager-cainjector-5d99449ffd-snvrc\" (UID: \"0093ceef-5e33-4b4e-b33f-bde7e8c5e3df\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" Jun 13 05:32:16.434921 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.434807 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0093ceef-5e33-4b4e-b33f-bde7e8c5e3df-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-snvrc\" (UID: \"0093ceef-5e33-4b4e-b33f-bde7e8c5e3df\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" Jun 13 05:32:16.536192 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.536162 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0093ceef-5e33-4b4e-b33f-bde7e8c5e3df-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-snvrc\" (UID: \"0093ceef-5e33-4b4e-b33f-bde7e8c5e3df\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" Jun 13 05:32:16.536346 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.536231 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qth8w\" (UniqueName: \"kubernetes.io/projected/0093ceef-5e33-4b4e-b33f-bde7e8c5e3df-kube-api-access-qth8w\") pod \"cert-manager-cainjector-5d99449ffd-snvrc\" (UID: \"0093ceef-5e33-4b4e-b33f-bde7e8c5e3df\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" Jun 13 05:32:16.547049 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.547015 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0093ceef-5e33-4b4e-b33f-bde7e8c5e3df-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-snvrc\" (UID: \"0093ceef-5e33-4b4e-b33f-bde7e8c5e3df\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" Jun 13 05:32:16.547188 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.547091 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qth8w\" (UniqueName: \"kubernetes.io/projected/0093ceef-5e33-4b4e-b33f-bde7e8c5e3df-kube-api-access-qth8w\") pod \"cert-manager-cainjector-5d99449ffd-snvrc\" (UID: \"0093ceef-5e33-4b4e-b33f-bde7e8c5e3df\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" Jun 13 05:32:16.700299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.700206 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" Jun 13 05:32:16.825553 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:16.825528 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-snvrc"] Jun 13 05:32:16.827964 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:32:16.827938 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0093ceef_5e33_4b4e_b33f_bde7e8c5e3df.slice/crio-e3cd7cd6a0a99814ec649a3eba4690093956a9144e5e94ce0c3f4384e0be1c1a WatchSource:0}: Error finding container e3cd7cd6a0a99814ec649a3eba4690093956a9144e5e94ce0c3f4384e0be1c1a: Status 404 returned error can't find the container with id e3cd7cd6a0a99814ec649a3eba4690093956a9144e5e94ce0c3f4384e0be1c1a Jun 13 05:32:17.333771 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:17.333687 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" event={"ID":"0093ceef-5e33-4b4e-b33f-bde7e8c5e3df","Type":"ContainerStarted","Data":"e3cd7cd6a0a99814ec649a3eba4690093956a9144e5e94ce0c3f4384e0be1c1a"} Jun 13 05:32:19.793745 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:19.793706 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:20.169432 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:20.169398 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:20.233906 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:20.233863 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:20.351900 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:20.351866 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" event={"ID":"0093ceef-5e33-4b4e-b33f-bde7e8c5e3df","Type":"ContainerStarted","Data":"c42058be5571b2c0adf2e5d43a951d86a8b44f4a9a9c430742242ae6cbb7b00f"} Jun 13 05:32:20.368561 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:20.368511 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-snvrc" podStartSLOduration=1.603119012 podStartE2EDuration="4.368495068s" totalImagesPullingTime="2.765376056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:32:20.367084264 +0000 UTC m=+475.347028149" watchObservedRunningTime="2026-06-13 05:32:20.368495068 +0000 UTC m=+475.348438960" Jun 13 05:32:31.617567 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:31.617527 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:31.718505 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:31.718467 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:33.449610 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.449583 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5"] Jun 13 05:32:33.453142 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.453118 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" Jun 13 05:32:33.455432 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.455412 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 13 05:32:33.456320 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.456304 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4mlww\"" Jun 13 05:32:33.456414 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.456324 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 13 05:32:33.459891 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.459831 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5"] Jun 13 05:32:33.571433 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.571405 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qc86\" (UniqueName: \"kubernetes.io/projected/69876cab-0cf8-40ce-a7a9-a084a8ac8095-kube-api-access-4qc86\") pod \"openshift-lws-operator-fd8ccff4c-xn8n5\" (UID: \"69876cab-0cf8-40ce-a7a9-a084a8ac8095\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" Jun 13 05:32:33.571564 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.571458 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69876cab-0cf8-40ce-a7a9-a084a8ac8095-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xn8n5\" (UID: \"69876cab-0cf8-40ce-a7a9-a084a8ac8095\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" Jun 13 05:32:33.672236 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.672212 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69876cab-0cf8-40ce-a7a9-a084a8ac8095-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xn8n5\" (UID: \"69876cab-0cf8-40ce-a7a9-a084a8ac8095\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" Jun 13 05:32:33.672327 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.672260 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qc86\" (UniqueName: \"kubernetes.io/projected/69876cab-0cf8-40ce-a7a9-a084a8ac8095-kube-api-access-4qc86\") pod \"openshift-lws-operator-fd8ccff4c-xn8n5\" (UID: \"69876cab-0cf8-40ce-a7a9-a084a8ac8095\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" Jun 13 05:32:33.672570 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.672552 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69876cab-0cf8-40ce-a7a9-a084a8ac8095-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xn8n5\" (UID: \"69876cab-0cf8-40ce-a7a9-a084a8ac8095\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" Jun 13 05:32:33.679816 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.679795 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qc86\" (UniqueName: \"kubernetes.io/projected/69876cab-0cf8-40ce-a7a9-a084a8ac8095-kube-api-access-4qc86\") pod \"openshift-lws-operator-fd8ccff4c-xn8n5\" (UID: \"69876cab-0cf8-40ce-a7a9-a084a8ac8095\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" Jun 13 05:32:33.762756 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.762705 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" Jun 13 05:32:33.890144 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:33.890088 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5"] Jun 13 05:32:33.892535 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:32:33.892507 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69876cab_0cf8_40ce_a7a9_a084a8ac8095.slice/crio-e1011111959d4b6ae4c2e869fa72b78b7fd7592ca7bf711fe99e705cb1d28922 WatchSource:0}: Error finding container e1011111959d4b6ae4c2e869fa72b78b7fd7592ca7bf711fe99e705cb1d28922: Status 404 returned error can't find the container with id e1011111959d4b6ae4c2e869fa72b78b7fd7592ca7bf711fe99e705cb1d28922 Jun 13 05:32:34.408717 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:34.408682 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" event={"ID":"69876cab-0cf8-40ce-a7a9-a084a8ac8095","Type":"ContainerStarted","Data":"e1011111959d4b6ae4c2e869fa72b78b7fd7592ca7bf711fe99e705cb1d28922"} Jun 13 05:32:36.418435 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:36.418401 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" event={"ID":"69876cab-0cf8-40ce-a7a9-a084a8ac8095","Type":"ContainerStarted","Data":"a092dd55f9dad96a47901be45d75c69a78b52d67a21ced6cf91d630e887f606e"} Jun 13 05:32:36.434433 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:36.434389 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xn8n5" podStartSLOduration=1.126337825 podStartE2EDuration="3.434373595s" totalImagesPullingTime="2.30803577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:32:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:32:36.432637436 +0000 UTC m=+491.412581342" watchObservedRunningTime="2026-06-13 05:32:36.434373595 +0000 UTC m=+491.414317485" Jun 13 05:32:37.192939 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:37.192905 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:37.242823 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:37.242791 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:39.086716 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:39.086677 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:45.346006 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.345966 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:45.398101 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.398058 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9"] Jun 13 05:32:45.401514 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.401491 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.405049 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.405023 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 13 05:32:45.405049 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.405037 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 13 05:32:45.405217 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.405044 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 13 05:32:45.405217 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.405159 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xr6gp\"" Jun 13 05:32:45.411582 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.411560 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9"] Jun 13 05:32:45.427579 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.427552 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:45.575428 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.575403 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/630ff1a6-6097-4410-9413-8f2fed28c504-metrics-cert\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.575592 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.575450 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/630ff1a6-6097-4410-9413-8f2fed28c504-manager-config\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.575592 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.575574 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpn7n\" (UniqueName: \"kubernetes.io/projected/630ff1a6-6097-4410-9413-8f2fed28c504-kube-api-access-hpn7n\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.575691 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.575646 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630ff1a6-6097-4410-9413-8f2fed28c504-cert\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.676806 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.676737 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpn7n\" (UniqueName: \"kubernetes.io/projected/630ff1a6-6097-4410-9413-8f2fed28c504-kube-api-access-hpn7n\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.676806 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.676787 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630ff1a6-6097-4410-9413-8f2fed28c504-cert\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.676991 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.676815 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/630ff1a6-6097-4410-9413-8f2fed28c504-metrics-cert\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.676991 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.676851 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/630ff1a6-6097-4410-9413-8f2fed28c504-manager-config\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.677607 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.677582 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/630ff1a6-6097-4410-9413-8f2fed28c504-manager-config\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.679414 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.679381 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/630ff1a6-6097-4410-9413-8f2fed28c504-cert\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.679501 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.679417 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/630ff1a6-6097-4410-9413-8f2fed28c504-metrics-cert\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.701457 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.701432 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpn7n\" (UniqueName: \"kubernetes.io/projected/630ff1a6-6097-4410-9413-8f2fed28c504-kube-api-access-hpn7n\") pod \"lws-controller-manager-9cbbb9567-bqbf9\" (UID: \"630ff1a6-6097-4410-9413-8f2fed28c504\") " pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.711135 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.711115 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:45.840375 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:45.840344 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9"] Jun 13 05:32:45.843402 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:32:45.843375 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630ff1a6_6097_4410_9413_8f2fed28c504.slice/crio-b5b3464637cd1671e35a47806b95cf63429da99942c20ea1b893910d9cba92af WatchSource:0}: Error finding container b5b3464637cd1671e35a47806b95cf63429da99942c20ea1b893910d9cba92af: Status 404 returned error can't find the container with id b5b3464637cd1671e35a47806b95cf63429da99942c20ea1b893910d9cba92af Jun 13 05:32:46.458474 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:46.458433 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" event={"ID":"630ff1a6-6097-4410-9413-8f2fed28c504","Type":"ContainerStarted","Data":"b5b3464637cd1671e35a47806b95cf63429da99942c20ea1b893910d9cba92af"} Jun 13 05:32:47.464373 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:47.464290 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" event={"ID":"630ff1a6-6097-4410-9413-8f2fed28c504","Type":"ContainerStarted","Data":"c4deb416e6d67f38ed837d29a90697dadb51d651eb366eda95043b1f10288fd0"} Jun 13 05:32:47.464373 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:47.464365 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:32:47.481371 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:47.481322 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" podStartSLOduration=1.089949391 podStartE2EDuration="2.48130826s" totalImagesPullingTime="1.391358869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:32:47.480035173 +0000 UTC m=+502.459979067" watchObservedRunningTime="2026-06-13 05:32:47.48130826 +0000 UTC m=+502.461252153" Jun 13 05:32:54.972888 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:54.972846 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:55.931347 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.931318 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g"] Jun 13 05:32:55.935900 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.935872 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:55.938127 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.938064 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 13 05:32:55.938333 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.938316 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 13 05:32:55.938469 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.938452 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 13 05:32:55.938572 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.938546 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 13 05:32:55.938825 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.938810 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-tl4cq\"" Jun 13 05:32:55.950472 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.950450 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g"] Jun 13 05:32:55.964034 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.964013 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/225a1f25-115e-4759-a263-518f9ad6bdd6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:55.964138 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.964052 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/225a1f25-115e-4759-a263-518f9ad6bdd6-manifests\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:55.964138 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.964095 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v6p8\" (UniqueName: \"kubernetes.io/projected/225a1f25-115e-4759-a263-518f9ad6bdd6-kube-api-access-8v6p8\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:55.964304 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.964165 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/225a1f25-115e-4759-a263-518f9ad6bdd6-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:55.964304 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.964209 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/225a1f25-115e-4759-a263-518f9ad6bdd6-tmp\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:55.966120 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:55.966092 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:56.065528 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.065503 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/225a1f25-115e-4759-a263-518f9ad6bdd6-manifests\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.065851 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.065552 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v6p8\" (UniqueName: \"kubernetes.io/projected/225a1f25-115e-4759-a263-518f9ad6bdd6-kube-api-access-8v6p8\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.065851 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.065585 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/225a1f25-115e-4759-a263-518f9ad6bdd6-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.065851 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.065615 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/225a1f25-115e-4759-a263-518f9ad6bdd6-tmp\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.065851 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.065688 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/225a1f25-115e-4759-a263-518f9ad6bdd6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.066065 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.065898 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/225a1f25-115e-4759-a263-518f9ad6bdd6-manifests\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.068034 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.068013 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/225a1f25-115e-4759-a263-518f9ad6bdd6-tmp\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.068245 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.068221 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/225a1f25-115e-4759-a263-518f9ad6bdd6-webhook-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.068245 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.068241 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/225a1f25-115e-4759-a263-518f9ad6bdd6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.073041 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.073014 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:56.073573 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.073555 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v6p8\" (UniqueName: \"kubernetes.io/projected/225a1f25-115e-4759-a263-518f9ad6bdd6-kube-api-access-8v6p8\") pod \"opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g\" (UID: \"225a1f25-115e-4759-a263-518f9ad6bdd6\") " pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.173379 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.173360 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:56.247271 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.247216 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:32:56.274632 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.274608 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:56.358590 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.358560 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:56.385302 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:32:56.385267 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod225a1f25_115e_4759_a263_518f9ad6bdd6.slice/crio-b1624d04e973b61c1466a077beb6b971e6da43ecedf288c8a958551014848d3b WatchSource:0}: Error finding container b1624d04e973b61c1466a077beb6b971e6da43ecedf288c8a958551014848d3b: Status 404 returned error can't find the container with id b1624d04e973b61c1466a077beb6b971e6da43ecedf288c8a958551014848d3b Jun 13 05:32:56.392831 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.392807 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g"] Jun 13 05:32:56.418607 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.418588 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:32:56.499222 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:56.499167 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" event={"ID":"225a1f25-115e-4759-a263-518f9ad6bdd6","Type":"ContainerStarted","Data":"b1624d04e973b61c1466a077beb6b971e6da43ecedf288c8a958551014848d3b"} Jun 13 05:32:58.469906 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:32:58.469877 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9cbbb9567-bqbf9" Jun 13 05:33:00.517611 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:00.517578 2584 generic.go:356] "Generic (PLEG): container finished" podID="225a1f25-115e-4759-a263-518f9ad6bdd6" containerID="f8c6566637b08d4e6e94f3f0d5520f64f74a69c65fd21f1ff97bceb668af3771" exitCode=0 Jun 13 05:33:00.517913 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:00.517649 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" event={"ID":"225a1f25-115e-4759-a263-518f9ad6bdd6","Type":"ContainerDied","Data":"f8c6566637b08d4e6e94f3f0d5520f64f74a69c65fd21f1ff97bceb668af3771"} Jun 13 05:33:01.524898 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:01.524856 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" event={"ID":"225a1f25-115e-4759-a263-518f9ad6bdd6","Type":"ContainerStarted","Data":"0d9cb43f5372bf17a5237355ad3d6ebddb8040b80d9d5a53b06e364314a676b1"} Jun 13 05:33:01.525291 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:01.525033 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:33:01.546648 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:01.546597 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" podStartSLOduration=2.232413454 podStartE2EDuration="6.54657965s" totalImagesPullingTime="3.391852463s" totalInitContainerRuntime="922.313733ms" isStatefulPod=false podCreationTimestamp="2026-06-13 05:32:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:01.544367935 +0000 UTC m=+516.524311828" watchObservedRunningTime="2026-06-13 05:33:01.54657965 +0000 UTC m=+516.526523545" Jun 13 05:33:12.532259 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:12.532188 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g" Jun 13 05:33:14.963609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:14.963562 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:15.070278 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.070227 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:15.285683 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.285642 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:15.359910 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.359881 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:15.503660 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.503625 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:15.556953 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.556876 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-666d479cbf-p48pd"] Jun 13 05:33:15.560491 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.560467 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.564040 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.564013 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 13 05:33:15.564210 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.564017 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 13 05:33:15.564288 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.564265 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tzh8z\"" Jun 13 05:33:15.564349 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.564292 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 13 05:33:15.564398 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.564302 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 13 05:33:15.570384 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.570361 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-666d479cbf-p48pd"] Jun 13 05:33:15.610859 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.610830 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:15.635933 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.635889 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d58abdaa-382c-444f-8d27-f1de6793a2e8-tls-certs\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.636124 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.635958 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d58abdaa-382c-444f-8d27-f1de6793a2e8-tmp\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.636124 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.636058 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dph8b\" (UniqueName: \"kubernetes.io/projected/d58abdaa-382c-444f-8d27-f1de6793a2e8-kube-api-access-dph8b\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.715429 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.715390 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:15.737396 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.737357 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dph8b\" (UniqueName: \"kubernetes.io/projected/d58abdaa-382c-444f-8d27-f1de6793a2e8-kube-api-access-dph8b\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.737550 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.737423 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d58abdaa-382c-444f-8d27-f1de6793a2e8-tls-certs\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.737550 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.737459 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d58abdaa-382c-444f-8d27-f1de6793a2e8-tmp\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.740066 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.740039 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d58abdaa-382c-444f-8d27-f1de6793a2e8-tmp\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.740066 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.740054 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d58abdaa-382c-444f-8d27-f1de6793a2e8-tls-certs\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.745394 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.745366 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dph8b\" (UniqueName: \"kubernetes.io/projected/d58abdaa-382c-444f-8d27-f1de6793a2e8-kube-api-access-dph8b\") pod \"kube-auth-proxy-666d479cbf-p48pd\" (UID: \"d58abdaa-382c-444f-8d27-f1de6793a2e8\") " pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:15.809630 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.809542 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:15.871149 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:15.871111 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" Jun 13 05:33:16.005686 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:16.005647 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-666d479cbf-p48pd"] Jun 13 05:33:16.009211 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:33:16.009179 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd58abdaa_382c_444f_8d27_f1de6793a2e8.slice/crio-f03fe351db8c4cf57ad1e3f4b974499a30a69edee712ce67af8d60b0503632a0 WatchSource:0}: Error finding container f03fe351db8c4cf57ad1e3f4b974499a30a69edee712ce67af8d60b0503632a0: Status 404 returned error can't find the container with id f03fe351db8c4cf57ad1e3f4b974499a30a69edee712ce67af8d60b0503632a0 Jun 13 05:33:16.059895 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:16.059806 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:16.226618 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:16.226583 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:16.595847 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:16.595808 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" event={"ID":"d58abdaa-382c-444f-8d27-f1de6793a2e8","Type":"ContainerStarted","Data":"f03fe351db8c4cf57ad1e3f4b974499a30a69edee712ce67af8d60b0503632a0"} Jun 13 05:33:19.613711 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:19.613625 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" event={"ID":"d58abdaa-382c-444f-8d27-f1de6793a2e8","Type":"ContainerStarted","Data":"5fdfc64989e92f143ff8928d83446e48416f2e2ba6f8407124651e88ca3be492"} Jun 13 05:33:19.629518 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:19.629471 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-666d479cbf-p48pd" podStartSLOduration=1.317721168 podStartE2EDuration="4.62945587s" totalImagesPullingTime="3.311734702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:33:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:33:19.62779684 +0000 UTC m=+534.607740733" watchObservedRunningTime="2026-06-13 05:33:19.62945587 +0000 UTC m=+534.609399761" Jun 13 05:33:25.261538 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:25.261500 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:25.436017 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:25.435984 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:25.542616 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:25.542581 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:25.659942 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:25.659903 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:26.626636 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:26.626600 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:26.734649 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:26.734615 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:26.859155 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:26.859106 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:33.634470 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:33.634429 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:33.748354 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:33.748317 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:34.863428 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:34.863384 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:34.978225 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:34.978192 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:35.573984 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:35.573945 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:35.668882 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:35.668830 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:36.197372 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:36.197330 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:45.814229 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:45.814186 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:46.122924 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:46.122828 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:46.223830 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:46.223791 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:46.434551 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:46.434442 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:46.534520 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:46.534476 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:46.758288 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:46.758204 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:50.474895 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:50.474855 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:50.574917 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:50.574888 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:50.776088 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:50.776046 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:51.061505 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:51.061421 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:51.408102 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:51.408014 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:53.079981 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:53.079948 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:53.130907 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:53.130876 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:33:53.884848 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:33:53.884814 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:16.591903 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:16.591864 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:16.689883 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:16.689850 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:16.762043 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:16.762009 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:17.510005 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:17.509975 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:17.717348 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:17.717312 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:25.477413 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:25.477383 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:34:25.478844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:25.478822 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:34:33.162469 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:33.162429 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:41.090804 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:41.090767 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:43.144697 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:43.144611 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:43.198983 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:43.198932 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:45.301922 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:45.301885 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:45.908313 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:45.908278 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:47.911870 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:47.911830 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:48.013031 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:48.012996 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:50.740585 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:50.740549 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:52.796184 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:52.796147 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:53.721202 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:53.721164 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:54.554914 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:54.554868 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:55.922233 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:55.922192 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:56.007488 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:56.007448 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:56.714246 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:56.714214 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:34:57.221387 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:34:57.221354 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:00.368844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:00.368805 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:02.317873 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:02.317833 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:02.419968 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:02.419939 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:02.720030 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:02.719939 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:02.820260 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:02.820229 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:06.118002 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:06.117963 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:06.198328 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:06.198289 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:07.310749 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:07.310702 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:07.418261 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:07.418233 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:07.531805 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:07.531765 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:07.634468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:07.634400 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:09.940671 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:09.940631 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:10.035581 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:10.035547 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:11.465962 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.465932 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2"] Jun 13 05:35:11.469480 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.469459 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.472236 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.472208 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 13 05:35:11.472356 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.472252 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 13 05:35:11.472356 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.472252 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 13 05:35:11.472356 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.472264 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 13 05:35:11.473022 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.473006 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hpx6f\"" Jun 13 05:35:11.480116 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.480020 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:11.493120 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.493061 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2"] Jun 13 05:35:11.588518 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.588485 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fa73714-0a20-40af-b658-074008b4d912-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.588654 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.588521 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxqkh\" (UniqueName: \"kubernetes.io/projected/9fa73714-0a20-40af-b658-074008b4d912-kube-api-access-fxqkh\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.588654 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.588634 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fa73714-0a20-40af-b658-074008b4d912-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.689763 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.689736 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fa73714-0a20-40af-b658-074008b4d912-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.689894 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.689800 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fa73714-0a20-40af-b658-074008b4d912-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.689894 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.689826 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxqkh\" (UniqueName: \"kubernetes.io/projected/9fa73714-0a20-40af-b658-074008b4d912-kube-api-access-fxqkh\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.689894 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:35:11.689885 2584 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 13 05:35:11.690030 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:35:11.689962 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fa73714-0a20-40af-b658-074008b4d912-plugin-serving-cert podName:9fa73714-0a20-40af-b658-074008b4d912 nodeName:}" failed. No retries permitted until 2026-06-13 05:35:12.189944884 +0000 UTC m=+647.169888758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/9fa73714-0a20-40af-b658-074008b4d912-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-rpsn2" (UID: "9fa73714-0a20-40af-b658-074008b4d912") : secret "plugin-serving-cert" not found Jun 13 05:35:11.690497 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.690479 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fa73714-0a20-40af-b658-074008b4d912-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.698883 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.698856 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxqkh\" (UniqueName: \"kubernetes.io/projected/9fa73714-0a20-40af-b658-074008b4d912-kube-api-access-fxqkh\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:11.891692 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:11.891658 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:12.193424 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:12.193335 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fa73714-0a20-40af-b658-074008b4d912-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:12.195866 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:12.195834 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9fa73714-0a20-40af-b658-074008b4d912-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-rpsn2\" (UID: \"9fa73714-0a20-40af-b658-074008b4d912\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:12.379344 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:12.379308 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" Jun 13 05:35:12.512134 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:12.512042 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2"] Jun 13 05:35:12.514340 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:35:12.514309 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fa73714_0a20_40af_b658_074008b4d912.slice/crio-5a0f02a55a5beaf5311b5562b12b2b403c0ec42ca2b93b2038b2fee2da4d45ff WatchSource:0}: Error finding container 5a0f02a55a5beaf5311b5562b12b2b403c0ec42ca2b93b2038b2fee2da4d45ff: Status 404 returned error can't find the container with id 5a0f02a55a5beaf5311b5562b12b2b403c0ec42ca2b93b2038b2fee2da4d45ff Jun 13 05:35:12.515714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:12.515698 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 05:35:13.149681 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:13.149646 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" event={"ID":"9fa73714-0a20-40af-b658-074008b4d912","Type":"ContainerStarted","Data":"5a0f02a55a5beaf5311b5562b12b2b403c0ec42ca2b93b2038b2fee2da4d45ff"} Jun 13 05:35:13.446142 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:13.446035 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:13.547659 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:13.547520 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:18.973816 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:18.973770 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:19.074233 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:19.074200 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:21.296774 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:21.296726 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:21.397808 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:21.397770 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:21.922655 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:21.922584 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:22.006511 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:22.006478 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:24.293682 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:24.293645 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:24.393916 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:24.393841 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:29.878430 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:29.878390 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:29.989549 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:29.989510 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:34.492631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:34.492588 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:34.591612 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:34.591578 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:35.276903 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:35.276862 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" event={"ID":"9fa73714-0a20-40af-b658-074008b4d912","Type":"ContainerStarted","Data":"77fc99cac09aa4cadc9b7d388729d4180b5c140e8473f0ba8d5c59ca85a57e97"} Jun 13 05:35:35.293146 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:35.293095 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-rpsn2" podStartSLOduration=1.639453562 podStartE2EDuration="24.293058953s" totalImagesPullingTime="22.653605391s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:35:35.291644714 +0000 UTC m=+670.271588607" watchObservedRunningTime="2026-06-13 05:35:35.293058953 +0000 UTC m=+670.273002845" Jun 13 05:35:50.766373 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:50.766335 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:35:50.830316 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:35:50.830278 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:03.460635 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:03.460587 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:03.564567 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:03.564533 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:03.662884 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:03.662848 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:04.009687 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.009649 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:36:04.086115 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.086043 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:36:04.086299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.086147 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:36:04.086299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.086062 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:04.088604 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.088586 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 13 05:36:04.133422 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.133389 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f3b8719e-5a2f-48ae-82a6-524cce62afc6-config-file\") pod \"limitador-limitador-54d6d988d5-8h7sf\" (UID: \"f3b8719e-5a2f-48ae-82a6-524cce62afc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:04.133615 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.133451 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmskx\" (UniqueName: \"kubernetes.io/projected/f3b8719e-5a2f-48ae-82a6-524cce62afc6-kube-api-access-lmskx\") pod \"limitador-limitador-54d6d988d5-8h7sf\" (UID: \"f3b8719e-5a2f-48ae-82a6-524cce62afc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:04.234567 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.234516 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f3b8719e-5a2f-48ae-82a6-524cce62afc6-config-file\") pod \"limitador-limitador-54d6d988d5-8h7sf\" (UID: \"f3b8719e-5a2f-48ae-82a6-524cce62afc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:04.234776 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.234616 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmskx\" (UniqueName: \"kubernetes.io/projected/f3b8719e-5a2f-48ae-82a6-524cce62afc6-kube-api-access-lmskx\") pod \"limitador-limitador-54d6d988d5-8h7sf\" (UID: \"f3b8719e-5a2f-48ae-82a6-524cce62afc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:04.235244 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.235221 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f3b8719e-5a2f-48ae-82a6-524cce62afc6-config-file\") pod \"limitador-limitador-54d6d988d5-8h7sf\" (UID: \"f3b8719e-5a2f-48ae-82a6-524cce62afc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:04.242322 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.242300 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmskx\" (UniqueName: \"kubernetes.io/projected/f3b8719e-5a2f-48ae-82a6-524cce62afc6-kube-api-access-lmskx\") pod \"limitador-limitador-54d6d988d5-8h7sf\" (UID: \"f3b8719e-5a2f-48ae-82a6-524cce62afc6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:04.348877 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.348831 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:04.396469 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.396437 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:04.450721 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.450676 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:04.530982 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.530954 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:36:04.533559 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:36:04.533532 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3b8719e_5a2f_48ae_82a6_524cce62afc6.slice/crio-36ea4ef7e91d79eb756f0dc267e91aada64fe685b547cf74382e11785bab9493 WatchSource:0}: Error finding container 36ea4ef7e91d79eb756f0dc267e91aada64fe685b547cf74382e11785bab9493: Status 404 returned error can't find the container with id 36ea4ef7e91d79eb756f0dc267e91aada64fe685b547cf74382e11785bab9493 Jun 13 05:36:04.565003 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.564973 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-d75br"] Jun 13 05:36:04.569589 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.569572 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d75br" Jun 13 05:36:04.571872 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.571854 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fr67g\"" Jun 13 05:36:04.580601 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.580571 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d75br"] Jun 13 05:36:04.637513 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.637427 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmk7v\" (UniqueName: \"kubernetes.io/projected/9f87cee7-731f-4dcc-aa28-78b3b7d57a70-kube-api-access-hmk7v\") pod \"authorino-75d556bd77-d75br\" (UID: \"9f87cee7-731f-4dcc-aa28-78b3b7d57a70\") " pod="kuadrant-system/authorino-75d556bd77-d75br" Jun 13 05:36:04.738736 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.738699 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmk7v\" (UniqueName: \"kubernetes.io/projected/9f87cee7-731f-4dcc-aa28-78b3b7d57a70-kube-api-access-hmk7v\") pod \"authorino-75d556bd77-d75br\" (UID: \"9f87cee7-731f-4dcc-aa28-78b3b7d57a70\") " pod="kuadrant-system/authorino-75d556bd77-d75br" Jun 13 05:36:04.748786 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.748751 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmk7v\" (UniqueName: \"kubernetes.io/projected/9f87cee7-731f-4dcc-aa28-78b3b7d57a70-kube-api-access-hmk7v\") pod \"authorino-75d556bd77-d75br\" (UID: \"9f87cee7-731f-4dcc-aa28-78b3b7d57a70\") " pod="kuadrant-system/authorino-75d556bd77-d75br" Jun 13 05:36:04.879048 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:04.879009 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d75br" Jun 13 05:36:05.078599 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:05.077262 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d75br"] Jun 13 05:36:05.080758 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:36:05.080726 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f87cee7_731f_4dcc_aa28_78b3b7d57a70.slice/crio-a2ad056e7b4f98972a09e09f23070f617a0c0357d1077f5d297a1ed001351e67 WatchSource:0}: Error finding container a2ad056e7b4f98972a09e09f23070f617a0c0357d1077f5d297a1ed001351e67: Status 404 returned error can't find the container with id a2ad056e7b4f98972a09e09f23070f617a0c0357d1077f5d297a1ed001351e67 Jun 13 05:36:05.420781 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:05.420715 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" event={"ID":"f3b8719e-5a2f-48ae-82a6-524cce62afc6","Type":"ContainerStarted","Data":"36ea4ef7e91d79eb756f0dc267e91aada64fe685b547cf74382e11785bab9493"} Jun 13 05:36:05.422636 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:05.422583 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d75br" event={"ID":"9f87cee7-731f-4dcc-aa28-78b3b7d57a70","Type":"ContainerStarted","Data":"a2ad056e7b4f98972a09e09f23070f617a0c0357d1077f5d297a1ed001351e67"} Jun 13 05:36:09.446620 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:09.446582 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" event={"ID":"f3b8719e-5a2f-48ae-82a6-524cce62afc6","Type":"ContainerStarted","Data":"3e9849f324e57f1d27be9de98baf57146a8a007475eee0ecc5e2077de5e021d1"} Jun 13 05:36:09.447139 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:09.446699 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:09.448240 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:09.448221 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d75br" event={"ID":"9f87cee7-731f-4dcc-aa28-78b3b7d57a70","Type":"ContainerStarted","Data":"377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0"} Jun 13 05:36:09.462586 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:09.462528 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" podStartSLOduration=1.7373724780000002 podStartE2EDuration="6.462515789s" totalImagesPullingTime="4.725143311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:36:09.460222885 +0000 UTC m=+704.440166777" watchObservedRunningTime="2026-06-13 05:36:09.462515789 +0000 UTC m=+704.442459680" Jun 13 05:36:09.473500 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:09.473449 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-d75br" podStartSLOduration=1.293222962 podStartE2EDuration="5.473436525s" totalImagesPullingTime="4.180213563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:36:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:36:09.472566052 +0000 UTC m=+704.452509962" watchObservedRunningTime="2026-06-13 05:36:09.473436525 +0000 UTC m=+704.453380416" Jun 13 05:36:20.453351 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:20.453271 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h7sf" Jun 13 05:36:23.871630 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:23.871591 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:32.750949 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:32.750908 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:32.857710 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:32.857682 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:32.995111 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:32.995057 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:57.258272 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:57.258236 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:36:57.312157 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:36:57.312117 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:27.769475 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:27.769438 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:27.930134 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:27.930102 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:27.998736 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:27.998703 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4jpcg"] Jun 13 05:37:28.000905 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.000888 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4jpcg" Jun 13 05:37:28.008576 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.008552 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4jpcg"] Jun 13 05:37:28.130951 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.130916 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtjpq\" (UniqueName: \"kubernetes.io/projected/5804b5d7-1917-4ef9-94dd-5906ca568830-kube-api-access-jtjpq\") pod \"authorino-5d4b67c446-4jpcg\" (UID: \"5804b5d7-1917-4ef9-94dd-5906ca568830\") " pod="kuadrant-system/authorino-5d4b67c446-4jpcg" Jun 13 05:37:28.215898 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.215864 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4jpcg"] Jun 13 05:37:28.216165 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:37:28.216140 2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jtjpq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-4jpcg" podUID="5804b5d7-1917-4ef9-94dd-5906ca568830" Jun 13 05:37:28.231442 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.231400 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtjpq\" (UniqueName: \"kubernetes.io/projected/5804b5d7-1917-4ef9-94dd-5906ca568830-kube-api-access-jtjpq\") pod \"authorino-5d4b67c446-4jpcg\" (UID: \"5804b5d7-1917-4ef9-94dd-5906ca568830\") " pod="kuadrant-system/authorino-5d4b67c446-4jpcg" Jun 13 05:37:28.259545 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.259518 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtjpq\" (UniqueName: \"kubernetes.io/projected/5804b5d7-1917-4ef9-94dd-5906ca568830-kube-api-access-jtjpq\") pod \"authorino-5d4b67c446-4jpcg\" (UID: \"5804b5d7-1917-4ef9-94dd-5906ca568830\") " pod="kuadrant-system/authorino-5d4b67c446-4jpcg" Jun 13 05:37:28.809001 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.808971 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4jpcg" Jun 13 05:37:28.816292 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.816270 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4jpcg" Jun 13 05:37:28.937418 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.937387 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtjpq\" (UniqueName: \"kubernetes.io/projected/5804b5d7-1917-4ef9-94dd-5906ca568830-kube-api-access-jtjpq\") pod \"5804b5d7-1917-4ef9-94dd-5906ca568830\" (UID: \"5804b5d7-1917-4ef9-94dd-5906ca568830\") " Jun 13 05:37:28.939561 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:28.939528 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5804b5d7-1917-4ef9-94dd-5906ca568830-kube-api-access-jtjpq" (OuterVolumeSpecName: "kube-api-access-jtjpq") pod "5804b5d7-1917-4ef9-94dd-5906ca568830" (UID: "5804b5d7-1917-4ef9-94dd-5906ca568830"). InnerVolumeSpecName "kube-api-access-jtjpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:37:29.038531 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:29.038503 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtjpq\" (UniqueName: \"kubernetes.io/projected/5804b5d7-1917-4ef9-94dd-5906ca568830-kube-api-access-jtjpq\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:37:29.813773 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:29.813740 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4jpcg" Jun 13 05:37:29.840406 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:29.840380 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4jpcg"] Jun 13 05:37:29.845905 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:29.845880 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4jpcg"] Jun 13 05:37:30.003758 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.003730 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d75br"] Jun 13 05:37:30.003928 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.003907 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-d75br" podUID="9f87cee7-731f-4dcc-aa28-78b3b7d57a70" containerName="authorino" containerID="cri-o://377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0" gracePeriod=30 Jun 13 05:37:30.266327 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.266304 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d75br" Jun 13 05:37:30.349289 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.349255 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmk7v\" (UniqueName: \"kubernetes.io/projected/9f87cee7-731f-4dcc-aa28-78b3b7d57a70-kube-api-access-hmk7v\") pod \"9f87cee7-731f-4dcc-aa28-78b3b7d57a70\" (UID: \"9f87cee7-731f-4dcc-aa28-78b3b7d57a70\") " Jun 13 05:37:30.351638 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.351612 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f87cee7-731f-4dcc-aa28-78b3b7d57a70-kube-api-access-hmk7v" (OuterVolumeSpecName: "kube-api-access-hmk7v") pod "9f87cee7-731f-4dcc-aa28-78b3b7d57a70" (UID: "9f87cee7-731f-4dcc-aa28-78b3b7d57a70"). InnerVolumeSpecName "kube-api-access-hmk7v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:37:30.450613 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.450522 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmk7v\" (UniqueName: \"kubernetes.io/projected/9f87cee7-731f-4dcc-aa28-78b3b7d57a70-kube-api-access-hmk7v\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:37:30.819770 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.819736 2584 generic.go:356] "Generic (PLEG): container finished" podID="9f87cee7-731f-4dcc-aa28-78b3b7d57a70" containerID="377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0" exitCode=0 Jun 13 05:37:30.820194 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.819776 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-d75br" Jun 13 05:37:30.820194 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.819818 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d75br" event={"ID":"9f87cee7-731f-4dcc-aa28-78b3b7d57a70","Type":"ContainerDied","Data":"377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0"} Jun 13 05:37:30.820194 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.819854 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-d75br" event={"ID":"9f87cee7-731f-4dcc-aa28-78b3b7d57a70","Type":"ContainerDied","Data":"a2ad056e7b4f98972a09e09f23070f617a0c0357d1077f5d297a1ed001351e67"} Jun 13 05:37:30.820194 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.819874 2584 scope.go:117] "RemoveContainer" containerID="377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0" Jun 13 05:37:30.828646 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.828630 2584 scope.go:117] "RemoveContainer" containerID="377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0" Jun 13 05:37:30.828931 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:37:30.828913 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0\": container with ID starting with 377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0 not found: ID does not exist" containerID="377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0" Jun 13 05:37:30.828981 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.828939 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0"} err="failed to get container status \"377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0\": rpc error: code = NotFound desc = could not find container \"377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0\": container with ID starting with 377d36383f5c5ade0fc1521738a867d1cbabbf7d064bd91ac4af012eb78357f0 not found: ID does not exist" Jun 13 05:37:30.859599 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.859578 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d75br"] Jun 13 05:37:30.862647 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:30.862628 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-d75br"] Jun 13 05:37:31.484228 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:31.484196 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5804b5d7-1917-4ef9-94dd-5906ca568830" path="/var/lib/kubelet/pods/5804b5d7-1917-4ef9-94dd-5906ca568830/volumes" Jun 13 05:37:31.484436 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:31.484424 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f87cee7-731f-4dcc-aa28-78b3b7d57a70" path="/var/lib/kubelet/pods/9f87cee7-731f-4dcc-aa28-78b3b7d57a70/volumes" Jun 13 05:37:33.551378 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.551336 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:33.563354 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.563321 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78464fd7c9-pjlk4"] Jun 13 05:37:33.563685 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.563673 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f87cee7-731f-4dcc-aa28-78b3b7d57a70" containerName="authorino" Jun 13 05:37:33.563731 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.563686 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f87cee7-731f-4dcc-aa28-78b3b7d57a70" containerName="authorino" Jun 13 05:37:33.563775 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.563746 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f87cee7-731f-4dcc-aa28-78b3b7d57a70" containerName="authorino" Jun 13 05:37:33.568262 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.568243 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:33.570714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.570691 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 13 05:37:33.570823 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.570719 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8j5l8\"" Jun 13 05:37:33.570823 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.570720 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 13 05:37:33.577835 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.577809 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78464fd7c9-pjlk4"] Jun 13 05:37:33.648883 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.648847 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:33.679374 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.679345 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert\") pod \"maas-controller-78464fd7c9-pjlk4\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:33.679510 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.679397 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cd4g\" (UniqueName: \"kubernetes.io/projected/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-kube-api-access-2cd4g\") pod \"maas-controller-78464fd7c9-pjlk4\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:33.698477 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.698447 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:33.735914 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.735883 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-86b75d6bf-jpmbh"] Jun 13 05:37:33.739503 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.739484 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:33.746967 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.746945 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86b75d6bf-jpmbh"] Jun 13 05:37:33.780474 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.780442 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert\") pod \"maas-controller-78464fd7c9-pjlk4\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:33.780631 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.780534 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cd4g\" (UniqueName: \"kubernetes.io/projected/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-kube-api-access-2cd4g\") pod \"maas-controller-78464fd7c9-pjlk4\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:33.780702 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:37:33.780660 2584 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 13 05:37:33.780757 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:37:33.780748 2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert podName:49bfd933-d97f-4bb1-8862-c4cfe35f9aa1 nodeName:}" failed. No retries permitted until 2026-06-13 05:37:34.280725641 +0000 UTC m=+789.260669516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert") pod "maas-controller-78464fd7c9-pjlk4" (UID: "49bfd933-d97f-4bb1-8862-c4cfe35f9aa1") : secret "maas-controller-webhook-cert" not found Jun 13 05:37:33.791231 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.791208 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cd4g\" (UniqueName: \"kubernetes.io/projected/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-kube-api-access-2cd4g\") pod \"maas-controller-78464fd7c9-pjlk4\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:33.828992 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.828926 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:33.881637 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.881612 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94xzq\" (UniqueName: \"kubernetes.io/projected/7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c-kube-api-access-94xzq\") pod \"maas-controller-86b75d6bf-jpmbh\" (UID: \"7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c\") " pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:33.881758 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.881657 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c-webhook-cert\") pod \"maas-controller-86b75d6bf-jpmbh\" (UID: \"7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c\") " pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:33.982259 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.982228 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94xzq\" (UniqueName: \"kubernetes.io/projected/7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c-kube-api-access-94xzq\") pod \"maas-controller-86b75d6bf-jpmbh\" (UID: \"7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c\") " pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:33.982356 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.982285 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c-webhook-cert\") pod \"maas-controller-86b75d6bf-jpmbh\" (UID: \"7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c\") " pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:33.984692 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.984665 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c-webhook-cert\") pod \"maas-controller-86b75d6bf-jpmbh\" (UID: \"7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c\") " pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:33.989791 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:33.989769 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94xzq\" (UniqueName: \"kubernetes.io/projected/7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c-kube-api-access-94xzq\") pod \"maas-controller-86b75d6bf-jpmbh\" (UID: \"7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c\") " pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:34.052506 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:34.052480 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:34.186961 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:34.186937 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-86b75d6bf-jpmbh"] Jun 13 05:37:34.188786 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:37:34.188760 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b40baa8_f5fa_4ec0_b8a2_d6c04da8c25c.slice/crio-a3425deeedead777621053e729fde0f265ce5ffe92e562383909684649baf33f WatchSource:0}: Error finding container a3425deeedead777621053e729fde0f265ce5ffe92e562383909684649baf33f: Status 404 returned error can't find the container with id a3425deeedead777621053e729fde0f265ce5ffe92e562383909684649baf33f Jun 13 05:37:34.284366 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:34.284339 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert\") pod \"maas-controller-78464fd7c9-pjlk4\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:34.286714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:34.286696 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert\") pod \"maas-controller-78464fd7c9-pjlk4\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:34.480238 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:34.480155 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:34.609960 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:34.609912 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78464fd7c9-pjlk4"] Jun 13 05:37:34.612649 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:37:34.612625 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49bfd933_d97f_4bb1_8862_c4cfe35f9aa1.slice/crio-5ece20d92092577c4f09ac8000d88d961301ce19181183bf40e9e76eabb1d1cb WatchSource:0}: Error finding container 5ece20d92092577c4f09ac8000d88d961301ce19181183bf40e9e76eabb1d1cb: Status 404 returned error can't find the container with id 5ece20d92092577c4f09ac8000d88d961301ce19181183bf40e9e76eabb1d1cb Jun 13 05:37:34.843668 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:34.843601 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" event={"ID":"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1","Type":"ContainerStarted","Data":"5ece20d92092577c4f09ac8000d88d961301ce19181183bf40e9e76eabb1d1cb"} Jun 13 05:37:34.845224 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:34.845192 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86b75d6bf-jpmbh" event={"ID":"7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c","Type":"ContainerStarted","Data":"a3425deeedead777621053e729fde0f265ce5ffe92e562383909684649baf33f"} Jun 13 05:37:36.858395 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:36.858355 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-86b75d6bf-jpmbh" event={"ID":"7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c","Type":"ContainerStarted","Data":"5a417c6676ebac1bde78b27a4660aba0bb87cbee99033949ecef8652a27d27aa"} Jun 13 05:37:36.858844 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:36.858430 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:36.859793 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:36.859766 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" event={"ID":"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1","Type":"ContainerStarted","Data":"2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81"} Jun 13 05:37:36.859909 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:36.859895 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:36.875377 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:36.875330 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-86b75d6bf-jpmbh" podStartSLOduration=1.34524299 podStartE2EDuration="3.875317052s" totalImagesPullingTime="2.530074062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:37:36.873062379 +0000 UTC m=+791.853006292" watchObservedRunningTime="2026-06-13 05:37:36.875317052 +0000 UTC m=+791.855260923" Jun 13 05:37:36.889829 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:36.889782 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" podStartSLOduration=1.773239624 podStartE2EDuration="3.889764388s" totalImagesPullingTime="2.116524764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:37:36.887550971 +0000 UTC m=+791.867494880" watchObservedRunningTime="2026-06-13 05:37:36.889764388 +0000 UTC m=+791.869708281" Jun 13 05:37:36.945914 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:36.945793 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:37.043040 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:37.042994 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:46.314438 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:46.314354 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:47.870639 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:47.870613 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:47.871101 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:47.870974 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-86b75d6bf-jpmbh" Jun 13 05:37:47.923720 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:47.923693 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78464fd7c9-pjlk4"] Jun 13 05:37:47.923885 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:47.923860 2584 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" podUID="49bfd933-d97f-4bb1-8862-c4cfe35f9aa1" containerName="manager" containerID="cri-o://2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81" gracePeriod=30 Jun 13 05:37:48.176055 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.176035 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:48.216608 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.216575 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert\") pod \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " Jun 13 05:37:48.216608 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.216616 2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cd4g\" (UniqueName: \"kubernetes.io/projected/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-kube-api-access-2cd4g\") pod \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\" (UID: \"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1\") " Jun 13 05:37:48.218714 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.218688 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "49bfd933-d97f-4bb1-8862-c4cfe35f9aa1" (UID: "49bfd933-d97f-4bb1-8862-c4cfe35f9aa1"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 13 05:37:48.218818 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.218743 2584 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-kube-api-access-2cd4g" (OuterVolumeSpecName: "kube-api-access-2cd4g") pod "49bfd933-d97f-4bb1-8862-c4cfe35f9aa1" (UID: "49bfd933-d97f-4bb1-8862-c4cfe35f9aa1"). InnerVolumeSpecName "kube-api-access-2cd4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 13 05:37:48.317696 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.317670 2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-webhook-cert\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:37:48.317696 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.317690 2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cd4g\" (UniqueName: \"kubernetes.io/projected/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1-kube-api-access-2cd4g\") on node \"ip-10-0-138-93.ec2.internal\" DevicePath \"\"" Jun 13 05:37:48.916336 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.916312 2584 generic.go:356] "Generic (PLEG): container finished" podID="49bfd933-d97f-4bb1-8862-c4cfe35f9aa1" containerID="2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81" exitCode=0 Jun 13 05:37:48.916644 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.916355 2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" Jun 13 05:37:48.916644 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.916356 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" event={"ID":"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1","Type":"ContainerDied","Data":"2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81"} Jun 13 05:37:48.916644 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.916488 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78464fd7c9-pjlk4" event={"ID":"49bfd933-d97f-4bb1-8862-c4cfe35f9aa1","Type":"ContainerDied","Data":"5ece20d92092577c4f09ac8000d88d961301ce19181183bf40e9e76eabb1d1cb"} Jun 13 05:37:48.916644 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.916511 2584 scope.go:117] "RemoveContainer" containerID="2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81" Jun 13 05:37:48.925171 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.924982 2584 scope.go:117] "RemoveContainer" containerID="2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81" Jun 13 05:37:48.925293 ip-10-0-138-93 kubenswrapper[2584]: E0613 05:37:48.925273 2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81\": container with ID starting with 2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81 not found: ID does not exist" containerID="2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81" Jun 13 05:37:48.925340 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.925304 2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81"} err="failed to get container status \"2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81\": rpc error: code = NotFound desc = could not find container \"2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81\": container with ID starting with 2a146628089dc1e6d82e539befebd6ba0c393076b14d215e391d4957355efd81 not found: ID does not exist" Jun 13 05:37:48.936862 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.936838 2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78464fd7c9-pjlk4"] Jun 13 05:37:48.940368 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:48.940347 2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78464fd7c9-pjlk4"] Jun 13 05:37:49.484569 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:49.484543 2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49bfd933-d97f-4bb1-8862-c4cfe35f9aa1" path="/var/lib/kubelet/pods/49bfd933-d97f-4bb1-8862-c4cfe35f9aa1/volumes" Jun 13 05:37:54.357948 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:54.357909 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:37:54.408433 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:37:54.408384 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:38:06.350973 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.350933 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:38:06.839359 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.839325 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:38:06.863629 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.863596 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cpsgr"] Jun 13 05:38:06.863978 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.863965 2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49bfd933-d97f-4bb1-8862-c4cfe35f9aa1" containerName="manager" Jun 13 05:38:06.864022 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.863979 2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="49bfd933-d97f-4bb1-8862-c4cfe35f9aa1" containerName="manager" Jun 13 05:38:06.864056 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.864037 2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="49bfd933-d97f-4bb1-8862-c4cfe35f9aa1" containerName="manager" Jun 13 05:38:06.868399 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.868380 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" Jun 13 05:38:06.870527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.870507 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 13 05:38:06.876867 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.876836 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cpsgr"] Jun 13 05:38:06.966607 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:06.966571 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfgcc\" (UniqueName: \"kubernetes.io/projected/472f6b13-7aee-40b1-a98b-b777d4303edb-kube-api-access-nfgcc\") pod \"payload-pre-processing-579785bc64-cpsgr\" (UID: \"472f6b13-7aee-40b1-a98b-b777d4303edb\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" Jun 13 05:38:07.067977 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:07.067936 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfgcc\" (UniqueName: \"kubernetes.io/projected/472f6b13-7aee-40b1-a98b-b777d4303edb-kube-api-access-nfgcc\") pod \"payload-pre-processing-579785bc64-cpsgr\" (UID: \"472f6b13-7aee-40b1-a98b-b777d4303edb\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" Jun 13 05:38:07.075786 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:07.075748 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfgcc\" (UniqueName: \"kubernetes.io/projected/472f6b13-7aee-40b1-a98b-b777d4303edb-kube-api-access-nfgcc\") pod \"payload-pre-processing-579785bc64-cpsgr\" (UID: \"472f6b13-7aee-40b1-a98b-b777d4303edb\") " pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" Jun 13 05:38:07.179923 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:07.179847 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" Jun 13 05:38:07.316402 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:07.316355 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-cpsgr"] Jun 13 05:38:07.318683 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:38:07.318655 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod472f6b13_7aee_40b1_a98b_b777d4303edb.slice/crio-48eb255a9184ca5d70535f7a05830615b05e5f55c627387b10c38c3c2b2423d0 WatchSource:0}: Error finding container 48eb255a9184ca5d70535f7a05830615b05e5f55c627387b10c38c3c2b2423d0: Status 404 returned error can't find the container with id 48eb255a9184ca5d70535f7a05830615b05e5f55c627387b10c38c3c2b2423d0 Jun 13 05:38:07.341823 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:07.341800 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:38:08.016289 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:08.016192 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" event={"ID":"472f6b13-7aee-40b1-a98b-b777d4303edb","Type":"ContainerStarted","Data":"48eb255a9184ca5d70535f7a05830615b05e5f55c627387b10c38c3c2b2423d0"} Jun 13 05:38:10.028561 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:10.028528 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" event={"ID":"472f6b13-7aee-40b1-a98b-b777d4303edb","Type":"ContainerStarted","Data":"b28cfbbdc240f52f81e65837e8d399bd431ebe02f9ca076a915368d3b32e6014"} Jun 13 05:38:10.028932 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:10.028589 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" Jun 13 05:38:10.043830 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:10.043786 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" podStartSLOduration=1.844353522 podStartE2EDuration="4.043771642s" totalImagesPullingTime="2.19941812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:38:10.042562317 +0000 UTC m=+825.022506212" watchObservedRunningTime="2026-06-13 05:38:10.043771642 +0000 UTC m=+825.023715681" Jun 13 05:38:21.035693 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:38:21.035667 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-cpsgr" Jun 13 05:39:25.512239 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:39:25.512204 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:39:25.514670 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:39:25.514640 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:40:17.818751 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:17.818717 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:40:47.760027 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:47.759951 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:40:48.836500 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:48.836469 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:40:56.842862 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.842830 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85cbdb5866-s4bw2"] Jun 13 05:40:56.846302 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.846277 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:56.849489 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.849457 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-fr67g\"" Jun 13 05:40:56.849606 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.849484 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 13 05:40:56.849606 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.849457 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 13 05:40:56.853387 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.853366 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85cbdb5866-s4bw2"] Jun 13 05:40:56.986748 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.986727 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-oidc-ca\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:56.986846 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.986780 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-tls-cert\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:56.986846 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:56.986808 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dpkl\" (UniqueName: \"kubernetes.io/projected/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-kube-api-access-2dpkl\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:57.087367 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.087337 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-tls-cert\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:57.087479 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.087381 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dpkl\" (UniqueName: \"kubernetes.io/projected/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-kube-api-access-2dpkl\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:57.087479 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.087413 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-oidc-ca\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:57.088031 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.087961 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-oidc-ca\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:57.089904 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.089880 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-tls-cert\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:57.094588 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.094534 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dpkl\" (UniqueName: \"kubernetes.io/projected/c799ded7-3eaf-4e96-89ab-d530ba2dbb04-kube-api-access-2dpkl\") pod \"authorino-85cbdb5866-s4bw2\" (UID: \"c799ded7-3eaf-4e96-89ab-d530ba2dbb04\") " pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:57.157632 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.157610 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85cbdb5866-s4bw2" Jun 13 05:40:57.287313 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.287287 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85cbdb5866-s4bw2"] Jun 13 05:40:57.290130 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:40:57.290105 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc799ded7_3eaf_4e96_89ab_d530ba2dbb04.slice/crio-2f70f4ee661d6abfc3ff74d6d24b6dd661db953c2d8eca47f144492626db8cb5 WatchSource:0}: Error finding container 2f70f4ee661d6abfc3ff74d6d24b6dd661db953c2d8eca47f144492626db8cb5: Status 404 returned error can't find the container with id 2f70f4ee661d6abfc3ff74d6d24b6dd661db953c2d8eca47f144492626db8cb5 Jun 13 05:40:57.291468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.291453 2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 13 05:40:57.778577 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:57.778553 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85cbdb5866-s4bw2" event={"ID":"c799ded7-3eaf-4e96-89ab-d530ba2dbb04","Type":"ContainerStarted","Data":"2f70f4ee661d6abfc3ff74d6d24b6dd661db953c2d8eca47f144492626db8cb5"} Jun 13 05:40:58.784137 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:58.784104 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85cbdb5866-s4bw2" event={"ID":"c799ded7-3eaf-4e96-89ab-d530ba2dbb04","Type":"ContainerStarted","Data":"6bbdba45c82c4568a329a4cea4d6e75b741a6a452f3f5a3805e1d67f2360a373"} Jun 13 05:40:58.798586 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:58.798535 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85cbdb5866-s4bw2" podStartSLOduration=2.315854038 podStartE2EDuration="2.798520836s" totalImagesPullingTime="482.666798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:40:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:40:58.79737999 +0000 UTC m=+993.777323883" watchObservedRunningTime="2026-06-13 05:40:58.798520836 +0000 UTC m=+993.778464728" Jun 13 05:40:59.464986 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:59.464959 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:40:59.563546 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:40:59.563517 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:41:22.702525 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:22.702490 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:41:23.076359 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:23.076321 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:41:37.484294 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.484268 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg"] Jun 13 05:41:37.487993 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.487975 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.491644 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.491622 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 13 05:41:37.491777 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.491714 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 13 05:41:37.491851 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.491813 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7k7mn\"" Jun 13 05:41:37.492108 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.492058 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 13 05:41:37.492891 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.492867 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg"] Jun 13 05:41:37.506042 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.506012 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:41:37.590938 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.590916 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.591018 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.590945 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqgqw\" (UniqueName: \"kubernetes.io/projected/13d67bf6-9227-4a8a-98bb-468c50f60847-kube-api-access-bqgqw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.591018 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.590973 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.591130 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.591018 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.591130 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.591055 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13d67bf6-9227-4a8a-98bb-468c50f60847-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.591195 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.591134 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692211 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692189 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692298 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692218 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692298 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692236 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqgqw\" (UniqueName: \"kubernetes.io/projected/13d67bf6-9227-4a8a-98bb-468c50f60847-kube-api-access-bqgqw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692298 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692268 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692412 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692306 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692412 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692352 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13d67bf6-9227-4a8a-98bb-468c50f60847-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692633 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692612 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692682 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692644 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.692719 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.692701 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.694629 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.694608 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13d67bf6-9227-4a8a-98bb-468c50f60847-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.694916 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.694895 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13d67bf6-9227-4a8a-98bb-468c50f60847-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.699372 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.699354 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqgqw\" (UniqueName: \"kubernetes.io/projected/13d67bf6-9227-4a8a-98bb-468c50f60847-kube-api-access-bqgqw\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6vlxg\" (UID: \"13d67bf6-9227-4a8a-98bb-468c50f60847\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.800140 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.800116 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:41:37.928401 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.928377 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg"] Jun 13 05:41:37.930934 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:41:37.930905 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d67bf6_9227_4a8a_98bb_468c50f60847.slice/crio-fe1ae6113d6b90839ae92fec174f940ef047ebac3ee0651e95d19a24109fcf36 WatchSource:0}: Error finding container fe1ae6113d6b90839ae92fec174f940ef047ebac3ee0651e95d19a24109fcf36: Status 404 returned error can't find the container with id fe1ae6113d6b90839ae92fec174f940ef047ebac3ee0651e95d19a24109fcf36 Jun 13 05:41:37.958825 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:37.958800 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" event={"ID":"13d67bf6-9227-4a8a-98bb-468c50f60847","Type":"ContainerStarted","Data":"fe1ae6113d6b90839ae92fec174f940ef047ebac3ee0651e95d19a24109fcf36"} Jun 13 05:41:38.076170 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:38.076097 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:41:41.982008 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:41.981967 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" event={"ID":"13d67bf6-9227-4a8a-98bb-468c50f60847","Type":"ContainerStarted","Data":"524b859622766aaf1c371dd2ed8b3f9bdb910440ff6d46bf5b17d4b3e8ec2bd0"} Jun 13 05:41:42.602584 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:42.602519 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:41:43.269138 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:43.269091 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:41:46.087354 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:46.087322 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:41:46.869130 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:41:46.869096 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:42:07.014314 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:07.014273 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:42:08.176455 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:08.176416 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:42:28.959206 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.959173 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr"] Jun 13 05:42:28.963233 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.963211 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:28.965562 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.965541 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 13 05:42:28.976613 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.976568 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr"] Jun 13 05:42:28.982518 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.982489 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:28.982635 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.982558 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:28.982635 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.982582 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:28.982635 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.982622 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:28.982752 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.982711 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzgnf\" (UniqueName: \"kubernetes.io/projected/fa1114ea-cb09-4833-8467-5731adde0567-kube-api-access-rzgnf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:28.982796 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.982748 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa1114ea-cb09-4833-8467-5731adde0567-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:28.991532 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:28.991506 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:42:29.083349 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083322 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.083446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083363 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.083446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083380 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.083446 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083407 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.083588 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083449 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzgnf\" (UniqueName: \"kubernetes.io/projected/fa1114ea-cb09-4833-8467-5731adde0567-kube-api-access-rzgnf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.083588 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083473 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa1114ea-cb09-4833-8467-5731adde0567-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.083733 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083712 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.083798 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083762 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.083863 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.083844 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.085621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.085604 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa1114ea-cb09-4833-8467-5731adde0567-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.085947 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.085930 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa1114ea-cb09-4833-8467-5731adde0567-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.090384 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.090362 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzgnf\" (UniqueName: \"kubernetes.io/projected/fa1114ea-cb09-4833-8467-5731adde0567-kube-api-access-rzgnf\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-bdzxr\" (UID: \"fa1114ea-cb09-4833-8467-5731adde0567\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.272183 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.272125 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" Jun 13 05:42:29.403954 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.403929 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr"] Jun 13 05:42:29.405604 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:42:29.405579 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1114ea_cb09_4833_8467_5731adde0567.slice/crio-8da79ecde40d7576f178647322228c635229121db6883f44d2f67e6efd708039 WatchSource:0}: Error finding container 8da79ecde40d7576f178647322228c635229121db6883f44d2f67e6efd708039: Status 404 returned error can't find the container with id 8da79ecde40d7576f178647322228c635229121db6883f44d2f67e6efd708039 Jun 13 05:42:29.977670 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:29.977633 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h7sf"] Jun 13 05:42:30.207692 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:30.207653 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" event={"ID":"fa1114ea-cb09-4833-8467-5731adde0567","Type":"ContainerStarted","Data":"7e27c927567788bbe94f23f9eb5ef3075cdb856f38dfe94daacc55d2f47c27b8"} Jun 13 05:42:30.207851 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:30.207703 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-bdzxr" event={"ID":"fa1114ea-cb09-4833-8467-5731adde0567","Type":"ContainerStarted","Data":"8da79ecde40d7576f178647322228c635229121db6883f44d2f67e6efd708039"} Jun 13 05:42:35.233143 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:35.233116 2584 generic.go:356] "Generic (PLEG): container finished" podID="13d67bf6-9227-4a8a-98bb-468c50f60847" containerID="524b859622766aaf1c371dd2ed8b3f9bdb910440ff6d46bf5b17d4b3e8ec2bd0" exitCode=0 Jun 13 05:42:35.233463 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:35.233198 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" event={"ID":"13d67bf6-9227-4a8a-98bb-468c50f60847","Type":"ContainerDied","Data":"524b859622766aaf1c371dd2ed8b3f9bdb910440ff6d46bf5b17d4b3e8ec2bd0"} Jun 13 05:42:37.244724 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:37.244689 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" event={"ID":"13d67bf6-9227-4a8a-98bb-468c50f60847","Type":"ContainerStarted","Data":"decfee098bdc063d921775e0f37690c0006d36f24feebfa294f32966ce469470"} Jun 13 05:42:37.264145 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:37.264098 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" podStartSLOduration=2.859809341 podStartE2EDuration="1m0.2640664s" totalImagesPullingTime="4.20730769s" totalInitContainerRuntime="53.196949369s" isStatefulPod=false podCreationTimestamp="2026-06-13 05:41:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:42:37.262253986 +0000 UTC m=+1092.242197890" watchObservedRunningTime="2026-06-13 05:42:37.2640664 +0000 UTC m=+1092.244010291" Jun 13 05:42:37.800988 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:37.800960 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:42:37.801122 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:37.801011 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:42:37.813013 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:37.812993 2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:42:38.260398 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:42:38.260335 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6vlxg" Jun 13 05:43:29.127402 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:43:29.127363 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:44:25.542783 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:44:25.542759 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:44:25.549066 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:44:25.549045 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8jcnk_2d374972-c83c-4e5c-8f76-df2bcf171205/ovn-acl-logging/0.log" Jun 13 05:46:00.354034 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:46:00.353996 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:46:00.400556 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:46:00.400522 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:48:37.186458 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:37.186430 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bdzxr_fa1114ea-cb09-4833-8467-5731adde0567/storage-initializer/0.log" Jun 13 05:48:38.123420 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:38.123392 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85cbdb5866-s4bw2_c799ded7-3eaf-4e96-89ab-d530ba2dbb04/authorino/0.log" Jun 13 05:48:43.337860 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:43.337833 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86b75d6bf-jpmbh_7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c/manager/0.log" Jun 13 05:48:43.802759 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:43.802736 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g_225a1f25-115e-4759-a263-518f9ad6bdd6/copy-manifests/0.log" Jun 13 05:48:43.814891 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:43.814872 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g_225a1f25-115e-4759-a263-518f9ad6bdd6/manager/0.log" Jun 13 05:48:45.325385 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:45.325362 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85cbdb5866-s4bw2_c799ded7-3eaf-4e96-89ab-d530ba2dbb04/authorino/0.log" Jun 13 05:48:45.658659 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:45.658597 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rpsn2_9fa73714-0a20-40af-b658-074008b4d912/kuadrant-console-plugin/0.log" Jun 13 05:48:46.008742 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:46.008676 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8h7sf_f3b8719e-5a2f-48ae-82a6-524cce62afc6/limitador/0.log" Jun 13 05:48:46.801014 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:46.800989 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-p48pd_d58abdaa-382c-444f-8d27-f1de6793a2e8/kube-auth-proxy/0.log" Jun 13 05:48:47.027516 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:47.027492 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpsgr_472f6b13-7aee-40b1-a98b-b777d4303edb/payload-pre-processing/0.log" Jun 13 05:48:47.707993 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:47.707943 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6vlxg_13d67bf6-9227-4a8a-98bb-468c50f60847/storage-initializer/0.log" Jun 13 05:48:47.714742 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:47.714720 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6vlxg_13d67bf6-9227-4a8a-98bb-468c50f60847/main/0.log" Jun 13 05:48:48.184619 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:48.184592 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-bdzxr_fa1114ea-cb09-4833-8467-5731adde0567/storage-initializer/0.log" Jun 13 05:48:52.669502 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:52.669469 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:48:53.614729 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:53.614701 2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" limit=1024 Jun 13 05:48:55.024154 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:55.024119 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nhw9l_d42a9998-9674-4087-b5f5-607ee9a3cf5b/global-pull-secret-syncer/0.log" Jun 13 05:48:55.067609 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:55.067586 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h4nhg_2d4ab06b-6c88-44fa-aee4-e66c1af57bf2/konnectivity-agent/0.log" Jun 13 05:48:55.159820 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:48:55.159799 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-93.ec2.internal_ccff225c871af651f16f48a149c73d62/haproxy/0.log" Jun 13 05:49:00.266681 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:00.266653 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-85cbdb5866-s4bw2_c799ded7-3eaf-4e96-89ab-d530ba2dbb04/authorino/0.log" Jun 13 05:49:00.360594 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:00.360571 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-rpsn2_9fa73714-0a20-40af-b658-074008b4d912/kuadrant-console-plugin/0.log" Jun 13 05:49:00.450643 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:00.450572 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8h7sf_f3b8719e-5a2f-48ae-82a6-524cce62afc6/limitador/0.log" Jun 13 05:49:02.267184 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.267157 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc3378ef-2553-4c91-b857-67b3951498f6/alertmanager/0.log" Jun 13 05:49:02.292526 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.292507 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc3378ef-2553-4c91-b857-67b3951498f6/config-reloader/0.log" Jun 13 05:49:02.314593 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.314571 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc3378ef-2553-4c91-b857-67b3951498f6/kube-rbac-proxy-web/0.log" Jun 13 05:49:02.340023 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.339972 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc3378ef-2553-4c91-b857-67b3951498f6/kube-rbac-proxy/0.log" Jun 13 05:49:02.362883 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.362860 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc3378ef-2553-4c91-b857-67b3951498f6/kube-rbac-proxy-metric/0.log" Jun 13 05:49:02.393809 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.393793 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc3378ef-2553-4c91-b857-67b3951498f6/prom-label-proxy/0.log" Jun 13 05:49:02.415941 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.415925 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cc3378ef-2553-4c91-b857-67b3951498f6/init-config-reloader/0.log" Jun 13 05:49:02.490159 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.490137 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8vjm_e574496f-f23d-450c-99f2-faefce8c0768/kube-state-metrics/0.log" Jun 13 05:49:02.510012 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.509981 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8vjm_e574496f-f23d-450c-99f2-faefce8c0768/kube-rbac-proxy-main/0.log" Jun 13 05:49:02.531853 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.531834 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-f8vjm_e574496f-f23d-450c-99f2-faefce8c0768/kube-rbac-proxy-self/0.log" Jun 13 05:49:02.691760 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.691704 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4hnb_ca6585f9-c7db-4b93-85d4-4509db0249a1/node-exporter/0.log" Jun 13 05:49:02.716109 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.716091 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4hnb_ca6585f9-c7db-4b93-85d4-4509db0249a1/kube-rbac-proxy/0.log" Jun 13 05:49:02.738149 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.738134 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j4hnb_ca6585f9-c7db-4b93-85d4-4509db0249a1/init-textfile/0.log" Jun 13 05:49:02.973095 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.973026 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7af68aae-5e34-463f-b210-c59f06f9ef08/prometheus/0.log" Jun 13 05:49:02.995150 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:02.995128 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7af68aae-5e34-463f-b210-c59f06f9ef08/config-reloader/0.log" Jun 13 05:49:03.021497 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.021476 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7af68aae-5e34-463f-b210-c59f06f9ef08/thanos-sidecar/0.log" Jun 13 05:49:03.042015 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.041995 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7af68aae-5e34-463f-b210-c59f06f9ef08/kube-rbac-proxy-web/0.log" Jun 13 05:49:03.064332 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.064312 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7af68aae-5e34-463f-b210-c59f06f9ef08/kube-rbac-proxy/0.log" Jun 13 05:49:03.085753 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.085735 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7af68aae-5e34-463f-b210-c59f06f9ef08/kube-rbac-proxy-thanos/0.log" Jun 13 05:49:03.106536 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.106521 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7af68aae-5e34-463f-b210-c59f06f9ef08/init-config-reloader/0.log" Jun 13 05:49:03.207964 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.207950 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-2z7dg_ee08c043-6837-4e29-a4a6-8e9c4a5b4f38/prometheus-operator-admission-webhook/0.log" Jun 13 05:49:03.243657 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.243603 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f7b554d9-6whjq_4dcc7533-7e0e-4f09-83e4-930ed58c0dca/telemeter-client/0.log" Jun 13 05:49:03.264872 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.264858 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f7b554d9-6whjq_4dcc7533-7e0e-4f09-83e4-930ed58c0dca/reload/0.log" Jun 13 05:49:03.288853 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:03.288837 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5f7b554d9-6whjq_4dcc7533-7e0e-4f09-83e4-930ed58c0dca/kube-rbac-proxy/0.log" Jun 13 05:49:04.745736 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:04.745711 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-c5djt_61f9d614-9416-47f4-97a8-605c1e86b71e/networking-console-plugin/0.log" Jun 13 05:49:05.333205 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.333178 2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd"] Jun 13 05:49:05.336898 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.336877 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.339572 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.339552 2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lcd84\"/\"default-dockercfg-446qj\"" Jun 13 05:49:05.339658 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.339588 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lcd84\"/\"openshift-service-ca.crt\"" Jun 13 05:49:05.340425 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.340406 2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lcd84\"/\"kube-root-ca.crt\"" Jun 13 05:49:05.345647 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.345626 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd"] Jun 13 05:49:05.453202 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.453179 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-podres\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.453299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.453240 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-lib-modules\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.453299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.453258 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-sys\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.453299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.453274 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-proc\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.453299 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.453292 2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdh8n\" (UniqueName: \"kubernetes.io/projected/de5861df-1eee-4731-9ff0-b0521b1a7d82-kube-api-access-qdh8n\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554402 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554377 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-podres\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554521 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554444 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-lib-modules\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554521 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554461 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-sys\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554521 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554477 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-proc\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554521 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554497 2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdh8n\" (UniqueName: \"kubernetes.io/projected/de5861df-1eee-4731-9ff0-b0521b1a7d82-kube-api-access-qdh8n\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554738 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554542 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-sys\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554738 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554563 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-proc\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554738 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554571 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-podres\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.554738 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.554586 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/de5861df-1eee-4731-9ff0-b0521b1a7d82-lib-modules\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.561621 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.561596 2584 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdh8n\" (UniqueName: \"kubernetes.io/projected/de5861df-1eee-4731-9ff0-b0521b1a7d82-kube-api-access-qdh8n\") pod \"perf-node-gather-daemonset-trmnd\" (UID: \"de5861df-1eee-4731-9ff0-b0521b1a7d82\") " pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.647314 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.647264 2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:05.775575 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:05.775549 2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd"] Jun 13 05:49:05.777323 ip-10-0-138-93 kubenswrapper[2584]: W0613 05:49:05.777296 2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podde5861df_1eee_4731_9ff0_b0521b1a7d82.slice/crio-62030f5721f518c9a6e9f246ff6155be4b2f282b05ff80e5c287b2c90f6472a3 WatchSource:0}: Error finding container 62030f5721f518c9a6e9f246ff6155be4b2f282b05ff80e5c287b2c90f6472a3: Status 404 returned error can't find the container with id 62030f5721f518c9a6e9f246ff6155be4b2f282b05ff80e5c287b2c90f6472a3 Jun 13 05:49:06.005580 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:06.005516 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" event={"ID":"de5861df-1eee-4731-9ff0-b0521b1a7d82","Type":"ContainerStarted","Data":"38ed227c1bbe364512fe624f7810ab8c20e19ef51a4c8dc39be3fe9fe584d9ea"} Jun 13 05:49:06.005580 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:06.005567 2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" event={"ID":"de5861df-1eee-4731-9ff0-b0521b1a7d82","Type":"ContainerStarted","Data":"62030f5721f518c9a6e9f246ff6155be4b2f282b05ff80e5c287b2c90f6472a3"} Jun 13 05:49:06.005705 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:06.005605 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:06.021034 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:06.020960 2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" podStartSLOduration=1.020945005 podStartE2EDuration="1.020945005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-13 05:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-13 05:49:06.020941246 +0000 UTC m=+1481.000885139" watchObservedRunningTime="2026-06-13 05:49:06.020945005 +0000 UTC m=+1481.000888898" Jun 13 05:49:06.647925 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:06.647903 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-8qb84_5333a442-870d-4eb7-934d-0623bb7ce7f1/volume-data-source-validator/0.log" Jun 13 05:49:07.845319 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:07.845293 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w54d4_c8014faf-8210-422e-afed-a4af9eb97e04/dns/0.log" Jun 13 05:49:07.865885 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:07.865864 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w54d4_c8014faf-8210-422e-afed-a4af9eb97e04/kube-rbac-proxy/0.log" Jun 13 05:49:07.936218 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:07.936201 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xjvfv_8dddcf0a-2034-4b38-a5c5-4592132ddc8a/dns-node-resolver/0.log" Jun 13 05:49:08.473678 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:08.473656 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b26pl_1b2682ad-26c1-430c-906c-87fd647f456f/node-ca/0.log" Jun 13 05:49:09.520833 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:09.520810 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-p48pd_d58abdaa-382c-444f-8d27-f1de6793a2e8/kube-auth-proxy/0.log" Jun 13 05:49:09.574022 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:09.574003 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpsgr_472f6b13-7aee-40b1-a98b-b777d4303edb/payload-pre-processing/0.log" Jun 13 05:49:10.248264 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:10.248243 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7dl2d_6b76dae1-0c22-4a9d-a7ef-3868336a2e2a/serve-healthcheck-canary/0.log" Jun 13 05:49:10.790914 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:10.790887 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-kx8lz_94b82225-6fde-42c6-9517-bcc799724be2/insights-operator/0.log" Jun 13 05:49:10.792471 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:10.792454 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-kx8lz_94b82225-6fde-42c6-9517-bcc799724be2/insights-operator/1.log" Jun 13 05:49:10.833373 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:10.833355 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f9b2m_7f5fda35-89d3-4cee-b5fe-fca68d984436/kube-rbac-proxy/0.log" Jun 13 05:49:10.869348 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:10.869330 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f9b2m_7f5fda35-89d3-4cee-b5fe-fca68d984436/exporter/0.log" Jun 13 05:49:10.910527 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:10.910511 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f9b2m_7f5fda35-89d3-4cee-b5fe-fca68d984436/extractor/0.log" Jun 13 05:49:12.020202 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:12.020177 2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lcd84/perf-node-gather-daemonset-trmnd" Jun 13 05:49:13.477976 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:13.477952 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-86b75d6bf-jpmbh_7b40baa8-f5fa-4ec0-b8a2-d6c04da8c25c/manager/0.log" Jun 13 05:49:13.642997 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:13.642969 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g_225a1f25-115e-4759-a263-518f9ad6bdd6/manager/0.log" Jun 13 05:49:13.658386 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:13.658367 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79b5dbf7d4-gwl6g_225a1f25-115e-4759-a263-518f9ad6bdd6/copy-manifests/0.log" Jun 13 05:49:15.615267 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:15.615246 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9cbbb9567-bqbf9_630ff1a6-6097-4410-9413-8f2fed28c504/manager/0.log" Jun 13 05:49:15.638933 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:15.638914 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xn8n5_69876cab-0cf8-40ce-a7a9-a084a8ac8095/openshift-lws-operator/0.log" Jun 13 05:49:19.629452 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:19.629426 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-p48pd_d58abdaa-382c-444f-8d27-f1de6793a2e8/kube-auth-proxy/0.log" Jun 13 05:49:19.660222 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:19.660197 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpsgr_472f6b13-7aee-40b1-a98b-b777d4303edb/payload-pre-processing/0.log" Jun 13 05:49:20.765084 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:20.765050 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-p48pd_d58abdaa-382c-444f-8d27-f1de6793a2e8/kube-auth-proxy/0.log" Jun 13 05:49:20.786681 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:20.786659 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-bp22s_75ad380c-0dcf-4259-a4af-97f81b71a5c5/migrator/0.log" Jun 13 05:49:20.794670 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:20.794654 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpsgr_472f6b13-7aee-40b1-a98b-b777d4303edb/payload-pre-processing/0.log" Jun 13 05:49:20.811468 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:20.811443 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-bp22s_75ad380c-0dcf-4259-a4af-97f81b71a5c5/graceful-termination/0.log" Jun 13 05:49:22.316013 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.315987 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6stm8_574a82e9-af75-4951-8aa8-25f7e73515bd/kube-multus/0.log" Jun 13 05:49:22.523501 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.523478 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-666d479cbf-p48pd_d58abdaa-382c-444f-8d27-f1de6793a2e8/kube-auth-proxy/0.log" Jun 13 05:49:22.556687 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.556669 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-cpsgr_472f6b13-7aee-40b1-a98b-b777d4303edb/payload-pre-processing/0.log" Jun 13 05:49:22.688901 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.688850 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvzzk_de0008d7-97be-4936-94a9-0f811a899ad8/kube-multus-additional-cni-plugins/0.log" Jun 13 05:49:22.709692 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.709674 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvzzk_de0008d7-97be-4936-94a9-0f811a899ad8/egress-router-binary-copy/0.log" Jun 13 05:49:22.729768 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.729748 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvzzk_de0008d7-97be-4936-94a9-0f811a899ad8/cni-plugins/0.log" Jun 13 05:49:22.749985 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.749970 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvzzk_de0008d7-97be-4936-94a9-0f811a899ad8/bond-cni-plugin/0.log" Jun 13 05:49:22.771148 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.771131 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvzzk_de0008d7-97be-4936-94a9-0f811a899ad8/routeoverride-cni/0.log" Jun 13 05:49:22.791783 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.791764 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvzzk_de0008d7-97be-4936-94a9-0f811a899ad8/whereabouts-cni-bincopy/0.log" Jun 13 05:49:22.811805 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.811790 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wvzzk_de0008d7-97be-4936-94a9-0f811a899ad8/whereabouts-cni/0.log" Jun 13 05:49:22.958522 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.958463 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-trmhx_cd190152-b46d-4522-ac9d-cc8f64fae7d4/network-metrics-daemon/0.log" Jun 13 05:49:22.978728 ip-10-0-138-93 kubenswrapper[2584]: I0613 05:49:22.978714 2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-trmhx_cd190152-b46d-4522-ac9d-cc8f64fae7d4/kube-rbac-proxy/0.log"