Jun 11 15:14:39.700433 ip-10-0-142-103 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 15:14:39.700447 ip-10-0-142-103 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 15:14:39.700457 ip-10-0-142-103 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 15:14:39.700868 ip-10-0-142-103 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 15:14:49.774616 ip-10-0-142-103 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 15:14:49.774637 ip-10-0-142-103 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b70055c3fb134b1eb615fb667dc7a481 -- Jun 11 15:17:30.864138 ip-10-0-142-103 systemd[1]: Starting Kubernetes Kubelet... Jun 11 15:17:31.283528 ip-10-0-142-103 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:17:31.283528 ip-10-0-142-103 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 15:17:31.283528 ip-10-0-142-103 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:17:31.283528 ip-10-0-142-103 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 15:17:31.283528 ip-10-0-142-103 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 15:17:31.284454 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.284368 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 15:17:31.287841 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287826 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:31.287841 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287841 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287845 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287848 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287852 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287854 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287858 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287861 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287864 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287867 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287870 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287873 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287875 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287878 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287881 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287884 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287886 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287889 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287891 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287894 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287897 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:31.287903 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287899 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287904 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287908 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287911 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287919 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287922 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287925 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287927 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287930 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287933 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287936 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287938 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287941 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287943 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287945 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287948 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287951 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287953 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287957 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:31.288385 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287960 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287963 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287965 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287968 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287970 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287973 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287975 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287978 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287980 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287983 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287985 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287987 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287990 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287992 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287995 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.287999 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288002 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288004 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288007 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288010 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:31.288869 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288013 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288015 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288018 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288021 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288023 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288026 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288028 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288031 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288033 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288036 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288038 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288041 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288043 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288046 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288049 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288052 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288054 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288057 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288059 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288063 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:31.289362 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288066 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288068 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288071 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288075 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288079 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288082 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288085 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288089 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288092 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288095 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288098 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288101 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288105 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288108 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288111 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288113 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288116 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288119 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288121 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:31.289870 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288820 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288827 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288831 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288833 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288836 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288839 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288842 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288845 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288850 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288857 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288862 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288865 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288868 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288871 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288874 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288877 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288880 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288883 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:31.290334 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288886 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288889 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288893 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288895 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288898 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288901 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288904 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288907 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288909 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288912 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288915 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288917 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288920 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288923 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288925 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288928 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288930 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288933 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288935 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288938 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:31.290798 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288941 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288943 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288946 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288948 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288951 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288954 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288957 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288959 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288962 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288964 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288967 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288969 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288973 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288976 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288979 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288981 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288984 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288987 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288989 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288992 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:31.291299 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288995 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.288998 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289000 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289003 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289006 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289009 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289011 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289014 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289017 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289019 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289022 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289024 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289027 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289030 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289032 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289034 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289037 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289040 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289043 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289045 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:31.291830 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289048 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289050 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289053 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289055 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289059 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289062 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289066 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289068 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289071 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289074 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289077 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289080 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289083 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289085 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289088 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289090 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289093 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289096 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289098 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:31.292316 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289100 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289103 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289460 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289465 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289467 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289470 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289473 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289477 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289480 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289482 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289485 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289488 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289491 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289494 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289497 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289499 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289502 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289504 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289507 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289510 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:31.292786 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289512 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289515 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289518 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289520 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289523 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289525 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289528 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289531 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289533 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289536 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289539 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289542 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289544 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289547 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289550 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289552 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289555 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289558 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289560 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:31.293295 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289563 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289566 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289569 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289571 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289574 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289577 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289580 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289582 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289585 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289587 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289590 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289593 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289597 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289601 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289605 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289608 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289610 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289613 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289616 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289618 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:31.293789 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289621 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289623 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289626 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289629 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289632 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289634 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289637 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289640 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289642 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289645 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289647 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289650 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289653 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289657 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289660 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289664 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289666 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289670 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289673 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289675 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:31.294272 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289679 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289682 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289685 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289687 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289691 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289694 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289697 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289700 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289703 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289707 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289709 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289712 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289714 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289717 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289719 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289724 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289726 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289729 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289732 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:31.294741 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289734 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289737 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.289739 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289845 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289856 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289867 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289873 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289877 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289881 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289885 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289889 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289893 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289896 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289900 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289903 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289907 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289909 2574 flags.go:64] FLAG: --cgroup-root="" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289912 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289915 2574 flags.go:64] FLAG: --client-ca-file="" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289918 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289921 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289925 2574 flags.go:64] FLAG: --cluster-domain="" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289928 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289931 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 15:17:31.295211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289934 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289938 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289941 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289944 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289948 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289952 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289955 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289958 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289961 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289964 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289967 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289970 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289977 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289979 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289982 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289985 2574 flags.go:64] FLAG: --enable-server="true" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289988 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289993 2574 flags.go:64] FLAG: --event-burst="100" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289996 2574 flags.go:64] FLAG: --event-qps="50" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.289999 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290002 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290006 2574 flags.go:64] FLAG: --eviction-hard="" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290009 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290012 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290015 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 15:17:31.295801 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290018 2574 flags.go:64] FLAG: --eviction-soft="" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290021 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290024 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290027 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290030 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290033 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290035 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290038 2574 flags.go:64] FLAG: --feature-gates="" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290042 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290045 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290048 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290052 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290055 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290058 2574 flags.go:64] FLAG: --help="false" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290061 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290064 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290067 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290070 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290073 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290078 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290081 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290083 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290086 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 15:17:31.296390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290089 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290092 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290095 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290098 2574 flags.go:64] FLAG: --kube-reserved="" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290101 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290105 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290108 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290111 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290113 2574 flags.go:64] FLAG: --lock-file="" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290116 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290120 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290123 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290128 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290130 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290133 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290140 2574 flags.go:64] FLAG: --logging-format="text" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290143 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290146 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290149 2574 flags.go:64] FLAG: --manifest-url="" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290152 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290156 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290160 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290164 2574 flags.go:64] FLAG: --max-pods="110" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290167 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290170 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 15:17:31.297027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290173 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290176 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290179 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290183 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290186 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290194 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290197 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290200 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290203 2574 flags.go:64] FLAG: --pod-cidr="" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290206 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290211 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290215 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290218 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290222 2574 flags.go:64] FLAG: --port="10250" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290225 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290228 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09d9b12378416e3e9" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290231 2574 flags.go:64] FLAG: --qos-reserved="" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290234 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290237 2574 flags.go:64] FLAG: --register-node="true" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290240 2574 flags.go:64] FLAG: --register-with-taints="" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290244 2574 flags.go:64] FLAG: --registry-burst="10" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290246 2574 flags.go:64] FLAG: --registry-qps="5" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290249 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290252 2574 flags.go:64] FLAG: --reserved-memory="" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290256 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 15:17:31.297726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290259 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290263 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290266 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290269 2574 flags.go:64] FLAG: --runonce="false" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290272 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290275 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290278 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290281 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290284 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290287 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290290 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290295 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290298 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290301 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290304 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290306 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290310 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290313 2574 flags.go:64] FLAG: --system-cgroups="" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290316 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290321 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290324 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290327 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290334 2574 flags.go:64] FLAG: --tls-min-version="" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290337 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290340 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 15:17:31.298371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290343 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290346 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290349 2574 flags.go:64] FLAG: --v="2" Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290353 2574 flags.go:64] FLAG: --version="false" Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290357 2574 flags.go:64] FLAG: --vmodule="" Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290360 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.290364 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290475 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290479 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290484 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290487 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290490 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290493 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290495 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290498 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290502 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290506 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290509 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290514 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290516 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:31.299041 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290520 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290523 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290527 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290530 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290533 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290536 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290539 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290542 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290544 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290548 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290551 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290553 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290556 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290559 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290561 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290564 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290567 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290569 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290572 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290574 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:31.299525 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290592 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290597 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290600 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290603 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290606 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290609 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290612 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290615 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290618 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290621 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290625 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290628 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290631 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290634 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290637 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290640 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290642 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290645 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290648 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290650 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:31.300035 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290653 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290656 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290659 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290661 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290664 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290667 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290670 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290672 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290675 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290678 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290680 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290683 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290686 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290689 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290692 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290695 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290697 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290700 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290703 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290705 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:31.300523 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290708 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290711 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290715 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290717 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290720 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290723 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290725 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290728 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290731 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290733 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290736 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290739 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290741 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290744 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290748 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290752 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290756 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290759 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290761 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:31.301016 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290764 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290766 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290782 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290785 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290788 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290790 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.290798 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.291324 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.298055 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.298073 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.298939 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.298946 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299027 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299032 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299036 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:31.301490 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299039 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299041 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299045 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299048 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299051 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299054 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299057 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299060 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299062 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299065 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299069 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299073 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299076 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299078 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299081 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299084 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299087 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299089 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299092 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299094 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:31.301886 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299097 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299100 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299102 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299104 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299107 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299109 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299119 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299121 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299124 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299127 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299129 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299132 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299135 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299137 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299140 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299143 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299145 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299148 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299150 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:31.302445 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299153 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299155 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299158 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299160 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299163 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299166 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299170 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299173 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299176 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299179 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299182 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299184 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299187 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299189 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299192 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299194 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299197 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299199 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299202 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299205 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:31.303257 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299213 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299216 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299219 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299221 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299224 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299226 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299229 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299232 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299234 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299237 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299239 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299242 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299244 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299247 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299249 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299252 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299254 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299257 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299259 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299262 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:31.303998 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299264 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299268 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299271 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299274 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299277 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299279 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299282 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299285 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299287 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299290 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299293 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299296 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299299 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299307 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299310 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299312 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:31.304491 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299315 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.299320 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299485 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299492 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299495 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299498 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299501 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299504 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299506 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299509 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299512 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299515 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299518 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299520 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299523 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 15:17:31.304944 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299526 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299529 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299532 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299534 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299537 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299540 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299542 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299545 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299548 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299550 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299553 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299555 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299558 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299567 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299570 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299578 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299581 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299583 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299586 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299588 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 15:17:31.305360 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299591 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299594 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299596 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299599 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299601 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299605 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299607 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299610 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299613 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299615 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299618 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299620 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299623 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299625 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299628 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299630 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299633 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299635 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299637 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 15:17:31.305878 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299640 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299642 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299645 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299647 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299650 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299652 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299655 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299658 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299660 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299669 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299671 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299674 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299677 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299680 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299683 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299685 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299688 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299690 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299693 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299695 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 15:17:31.306357 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299698 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299700 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299703 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299705 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299709 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299712 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299715 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299718 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299720 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299723 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299726 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299728 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299731 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299734 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299736 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299739 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299741 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299744 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299746 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 15:17:31.306873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299749 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299751 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299754 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299762 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299764 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299783 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299787 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:31.299789 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.299794 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.299924 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.302078 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.306608 2574 server.go:1019] "Starting client certificate rotation" Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.306717 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:17:31.307333 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.306754 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 15:17:31.309287 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.309272 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:17:31.310704 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.310688 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 15:17:31.325975 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.325956 2574 log.go:25] "Validated CRI v1 runtime API" Jun 11 15:17:31.328862 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.328848 2574 log.go:25] "Validated CRI v1 image API" Jun 11 15:17:31.329640 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.329622 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 15:17:31.332836 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.332818 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8ff34edc-6c4b-413f-a18d-cc88aab22155:/dev/nvme0n1p4 b5597ac9-f7ed-46e7-85d1-2983c33f28a8:/dev/nvme0n1p3] Jun 11 15:17:31.332902 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.332835 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 15:17:31.338281 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.338045 2574 manager.go:216] Machine: {Timestamp:2026-06-11 15:17:31.336849165 +0000 UTC m=+0.353000432 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094901 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ddd04f05098863e8de8cb22b5ba6f SystemUUID:ec2ddd04-f050-9886-3e8d-e8cb22b5ba6f BootID:b70055c3-fb13-4b1e-b615-fb667dc7a481 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:a6:c1:ba:15:1f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:a6:c1:ba:15:1f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:64:9e:a3:4f:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 15:17:31.338281 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.338270 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 15:17:31.338420 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.338349 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 15:17:31.339600 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.339584 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:17:31.340795 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.340761 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 15:17:31.340974 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.340799 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-103.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 15:17:31.341515 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.341505 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 15:17:31.341545 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.341517 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 15:17:31.341545 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.341525 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:17:31.342162 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.342150 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 15:17:31.342993 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.342983 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 15:17:31.345905 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.345894 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:17:31.346026 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.346017 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 15:17:31.346056 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.346052 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 11 15:17:31.346085 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.346062 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 15:17:31.346116 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.346091 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 15:17:31.346116 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.346101 2574 kubelet.go:398] "Adding apiserver pod source" Jun 11 15:17:31.346116 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.346110 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 15:17:31.346636 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.346620 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:17:31.346691 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.346654 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 15:17:31.350670 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.350302 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 15:17:31.351580 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.351568 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 15:17:31.351633 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.351597 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 15:17:31.352662 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352649 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 15:17:31.352719 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352667 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 15:17:31.352719 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352674 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 15:17:31.352719 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352681 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 15:17:31.352719 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352694 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 15:17:31.352719 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352702 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 15:17:31.352719 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352710 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 15:17:31.352719 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352716 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 15:17:31.352918 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352722 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 15:17:31.352918 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352728 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 15:17:31.352918 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352736 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 15:17:31.352918 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.352742 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 15:17:31.353834 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.353823 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 15:17:31.353834 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.353833 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 15:17:31.356960 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.356947 2574 server.go:1268] "Started kubelet" Jun 11 15:17:31.357064 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.357020 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 15:17:31.357117 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.357036 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 15:17:31.357117 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.357085 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 15:17:31.357830 ip-10-0-142-103 systemd[1]: Started Kubernetes Kubelet. Jun 11 15:17:31.358699 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.358681 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 15:17:31.359685 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.359672 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 11 15:17:31.361995 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.361976 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-103.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 15:17:31.362380 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.362360 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 15:17:31.362533 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.362519 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 15:17:31.362920 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.361964 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-103.ec2.internal.18b80fd2f53bdbee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-103.ec2.internal,UID:ip-10-0-142-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-103.ec2.internal,},FirstTimestamp:2026-06-11 15:17:31.356920814 +0000 UTC m=+0.373072081,LastTimestamp:2026-06-11 15:17:31.356920814 +0000 UTC m=+0.373072081,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-103.ec2.internal,}" Jun 11 15:17:31.364005 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.363987 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 15:17:31.364672 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.364653 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 15:17:31.364672 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.364667 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 15:17:31.364829 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.364809 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:31.365485 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.365464 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 15:17:31.365485 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.365488 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 15:17:31.365625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.365466 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 15:17:31.365693 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.365632 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 11 15:17:31.365693 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.365640 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 11 15:17:31.365693 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.365673 2574 factory.go:55] Registering systemd factory Jun 11 15:17:31.365693 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.365688 2574 factory.go:223] Registration of the systemd container factory successfully Jun 11 15:17:31.366074 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.366056 2574 factory.go:153] Registering CRI-O factory Jun 11 15:17:31.366143 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.366077 2574 factory.go:223] Registration of the crio container factory successfully Jun 11 15:17:31.366186 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.366163 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 15:17:31.366230 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.366189 2574 factory.go:103] Registering Raw factory Jun 11 15:17:31.366230 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.366212 2574 manager.go:1196] Started watching for new ooms in manager Jun 11 15:17:31.366590 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.366561 2574 manager.go:349] Starting recovery of all containers Jun 11 15:17:31.369410 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.369383 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 15:17:31.369515 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.369492 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-103.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 15:17:31.377692 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.376352 2574 manager.go:354] Recovery completed Jun 11 15:17:31.381584 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.381572 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:31.383342 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.383327 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:31.383403 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.383357 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:31.383403 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.383371 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:31.383914 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.383902 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 15:17:31.383914 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.383913 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 15:17:31.384022 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.383929 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 15:17:31.384022 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.383903 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:31.384633 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.384618 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:31.384708 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.384646 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:31.384708 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.384660 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:31.385074 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.385062 2574 policy_none.go:49] "None policy: Start" Jun 11 15:17:31.385125 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.385078 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 15:17:31.385125 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.385087 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 15:17:31.386229 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.386209 2574 policy_none.go:47] "Start" Jun 11 15:17:31.386323 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.386185 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-103.ec2.internal.18b80fd2f6cf083d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-103.ec2.internal,UID:ip-10-0-142-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-103.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-103.ec2.internal,},FirstTimestamp:2026-06-11 15:17:31.383343165 +0000 UTC m=+0.399494434,LastTimestamp:2026-06-11 15:17:31.383343165 +0000 UTC m=+0.399494434,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-103.ec2.internal,}" Jun 11 15:17:31.401264 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.401231 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6pwqd" Jun 11 15:17:31.402068 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.402008 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-103.ec2.internal.18b80fd2f6cf5bc8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-103.ec2.internal,UID:ip-10-0-142-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-103.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-103.ec2.internal,},FirstTimestamp:2026-06-11 15:17:31.383364552 +0000 UTC m=+0.399515817,LastTimestamp:2026-06-11 15:17:31.383364552 +0000 UTC m=+0.399515817,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-103.ec2.internal,}" Jun 11 15:17:31.412848 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.412830 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6pwqd" Jun 11 15:17:31.418480 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.418418 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-103.ec2.internal.18b80fd2f6cf83dd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-103.ec2.internal,UID:ip-10-0-142-103.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-103.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-103.ec2.internal,},FirstTimestamp:2026-06-11 15:17:31.383374813 +0000 UTC m=+0.399526078,LastTimestamp:2026-06-11 15:17:31.383374813 +0000 UTC m=+0.399526078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-103.ec2.internal,}" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.419423 2574 manager.go:337] "Starting Device Plugin manager" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.419451 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.419460 2574 server.go:87] "Starting device plugin registration server" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.419685 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.419696 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.419798 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.419885 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.419894 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.420715 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.420766 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.431922 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.433113 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.433145 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.433165 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 15:17:31.436353 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.433243 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 15:17:31.437600 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.437583 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:31.520173 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.520121 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:31.521238 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.521220 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:31.521337 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.521251 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:31.521337 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.521262 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:31.521337 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.521287 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.532087 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.532067 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.532151 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.532095 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-103.ec2.internal\": node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:31.534243 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.534223 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal"] Jun 11 15:17:31.534304 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.534295 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:31.535489 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.535468 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:31.535587 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.535505 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:31.535587 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.535521 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:31.537206 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.537192 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:31.537314 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.537299 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.537350 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.537333 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:31.538399 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.538384 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:31.538399 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.538393 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:31.538488 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.538414 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:31.538488 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.538419 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:31.538488 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.538427 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:31.538488 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.538430 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:31.539818 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.539803 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.539871 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.539835 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 15:17:31.540558 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.540540 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientMemory" Jun 11 15:17:31.540662 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.540566 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 15:17:31.540662 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.540577 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeHasSufficientPID" Jun 11 15:17:31.561701 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.561676 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:31.566868 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.566849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/afbbb6aa168f6c7fe506418ce73f5b8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal\" (UID: \"afbbb6aa168f6c7fe506418ce73f5b8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.566963 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.566872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afbbb6aa168f6c7fe506418ce73f5b8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal\" (UID: \"afbbb6aa168f6c7fe506418ce73f5b8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.566963 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.566889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6433c8eee751c3d2240369462b2d4f86-config\") pod \"kube-apiserver-proxy-ip-10-0-142-103.ec2.internal\" (UID: \"6433c8eee751c3d2240369462b2d4f86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.568536 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.568518 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-103.ec2.internal\" not found" node="ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.572884 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.572867 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-103.ec2.internal\" not found" node="ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.661944 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.661911 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:31.667307 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.667277 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/afbbb6aa168f6c7fe506418ce73f5b8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal\" (UID: \"afbbb6aa168f6c7fe506418ce73f5b8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.667371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.667312 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/afbbb6aa168f6c7fe506418ce73f5b8e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal\" (UID: \"afbbb6aa168f6c7fe506418ce73f5b8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.667371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.667331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afbbb6aa168f6c7fe506418ce73f5b8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal\" (UID: \"afbbb6aa168f6c7fe506418ce73f5b8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.667371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.667366 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/afbbb6aa168f6c7fe506418ce73f5b8e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal\" (UID: \"afbbb6aa168f6c7fe506418ce73f5b8e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.667467 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.667369 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6433c8eee751c3d2240369462b2d4f86-config\") pod \"kube-apiserver-proxy-ip-10-0-142-103.ec2.internal\" (UID: \"6433c8eee751c3d2240369462b2d4f86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.667467 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.667397 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6433c8eee751c3d2240369462b2d4f86-config\") pod \"kube-apiserver-proxy-ip-10-0-142-103.ec2.internal\" (UID: \"6433c8eee751c3d2240369462b2d4f86\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.762505 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.762425 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:31.863148 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.863104 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:31.872614 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.872588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.877621 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:31.877603 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" Jun 11 15:17:31.964251 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:31.964214 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:32.064818 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:32.064729 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:32.165188 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:32.165161 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:32.259213 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.259185 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:32.265263 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:32.265239 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:32.307552 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.307524 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 15:17:32.308213 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.307677 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:17:32.308213 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.307704 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 15:17:32.365803 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:32.365763 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:32.374726 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:32.374693 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6433c8eee751c3d2240369462b2d4f86.slice/crio-aef269d556f0f53ff10886066ce71ef4acc5134bb002d6395a3b17136232e000 WatchSource:0}: Error finding container aef269d556f0f53ff10886066ce71ef4acc5134bb002d6395a3b17136232e000: Status 404 returned error can't find the container with id aef269d556f0f53ff10886066ce71ef4acc5134bb002d6395a3b17136232e000 Jun 11 15:17:32.375326 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:32.375299 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafbbb6aa168f6c7fe506418ce73f5b8e.slice/crio-e8682511321331cbdc9885017645900104c92f441d39f13cf4c84ccf9993ad38 WatchSource:0}: Error finding container e8682511321331cbdc9885017645900104c92f441d39f13cf4c84ccf9993ad38: Status 404 returned error can't find the container with id e8682511321331cbdc9885017645900104c92f441d39f13cf4c84ccf9993ad38 Jun 11 15:17:32.381668 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.381654 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:17:32.415112 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.415081 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:32.415112 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.415096 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 15:12:31 +0000 UTC" deadline="2028-01-12 16:30:22.388512585 +0000 UTC" Jun 11 15:17:32.415291 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.415121 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13921h12m49.973395016s" Jun 11 15:17:32.437309 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.437247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" event={"ID":"afbbb6aa168f6c7fe506418ce73f5b8e","Type":"ContainerStarted","Data":"e8682511321331cbdc9885017645900104c92f441d39f13cf4c84ccf9993ad38"} Jun 11 15:17:32.438296 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.438275 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" event={"ID":"6433c8eee751c3d2240369462b2d4f86","Type":"ContainerStarted","Data":"aef269d556f0f53ff10886066ce71ef4acc5134bb002d6395a3b17136232e000"} Jun 11 15:17:32.466524 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:32.466499 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-103.ec2.internal\" not found" Jun 11 15:17:32.503081 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.503058 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:32.565803 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.565755 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" Jun 11 15:17:32.580663 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.580639 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:17:32.581971 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.581956 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" Jun 11 15:17:32.590899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:32.590884 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 15:17:33.347292 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.347242 2574 apiserver.go:52] "Watching apiserver" Jun 11 15:17:33.353709 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.353676 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 15:17:33.354159 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.354136 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-nwhjd","openshift-multus/multus-additional-cni-plugins-r94bg","openshift-network-operator/iptables-alerter-tv6dq","openshift-ovn-kubernetes/ovnkube-node-hzfnj","kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6","openshift-cluster-node-tuning-operator/tuned-26jts","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal","openshift-multus/multus-64bvv","openshift-multus/network-metrics-daemon-58xmz","openshift-network-diagnostics/network-check-target-xq5jl","kube-system/global-pull-secret-syncer-r8rd8","kube-system/konnectivity-agent-csjrc","openshift-dns/node-resolver-tk8cn"] Jun 11 15:17:33.355870 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.355838 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.356959 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.356936 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:33.357080 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.357021 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:33.358287 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.358140 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.358631 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.358600 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:17:33.358977 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.358960 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 15:17:33.359079 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.358988 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vj792\"" Jun 11 15:17:33.359943 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.359703 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.361152 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.360660 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 15:17:33.361152 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.360784 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.361152 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.360886 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 15:17:33.361387 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.361168 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:17:33.361387 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.361361 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lwck2\"" Jun 11 15:17:33.362397 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.362154 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 15:17:33.362486 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.362405 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.363244 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363210 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 15:17:33.363361 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363210 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 15:17:33.364065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363531 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.364065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363663 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 15:17:33.364065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363714 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 15:17:33.364065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363806 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-52zkt\"" Jun 11 15:17:33.364065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363902 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 15:17:33.364065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363956 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 15:17:33.364065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.363664 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 15:17:33.364065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.364010 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qzprj\"" Jun 11 15:17:33.364716 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.364697 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:33.365886 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.365805 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 15:17:33.366977 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.366650 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.367633 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.367615 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:33.367729 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.367706 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:33.368848 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.368800 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 15:17:33.368951 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.368871 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 15:17:33.369075 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.369044 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 15:17:33.369168 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.369133 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.370102 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.369955 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gkl8n\"" Jun 11 15:17:33.370102 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.369972 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 15:17:33.370102 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.370040 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 15:17:33.370506 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.370443 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 15:17:33.371996 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.371374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.371996 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.371467 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:33.371996 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.371556 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 15:17:33.371996 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.371944 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 15:17:33.373155 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.372386 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 15:17:33.373155 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.372543 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8ztsq\"" Jun 11 15:17:33.373155 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.372568 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 15:17:33.373155 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.372660 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 15:17:33.373384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.373270 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 15:17:33.373384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.373299 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 15:17:33.373384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.373343 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 15:17:33.373540 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.373391 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hn42x\"" Jun 11 15:17:33.373650 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.373619 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c2c5t\"" Jun 11 15:17:33.374922 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.374899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfssn\" (UniqueName: \"kubernetes.io/projected/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-kube-api-access-mfssn\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.375026 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.374938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.375026 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.374966 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af89228b-8f74-46bf-a480-99c2e108ed8b-konnectivity-ca\") pod \"konnectivity-agent-csjrc\" (UID: \"af89228b-8f74-46bf-a480-99c2e108ed8b\") " pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:33.375026 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-socket-dir-parent\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.375180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysctl-conf\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.375180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81facbea-5b6a-4ce5-a032-14c36a240349-etc-tuned\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.375180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375136 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-run-netns\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.375384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375186 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-node-log\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.375384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375223 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vshq\" (UniqueName: \"kubernetes.io/projected/3764e623-e2d7-481b-8a42-3468c6646be7-kube-api-access-2vshq\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.375384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.375384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375287 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d18494eb-fd32-4d7c-b051-4f1b515de240-ovn-node-metrics-cert\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.375384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375331 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zlct\" (UniqueName: \"kubernetes.io/projected/d18494eb-fd32-4d7c-b051-4f1b515de240-kube-api-access-6zlct\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.375384 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-os-release\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.375654 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-run\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.375654 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375446 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-cni-netd\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.375654 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-env-overrides\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.375654 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cnibin\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.375654 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-os-release\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.375654 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-multus-certs\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.375654 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysctl-d\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375662 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-etc-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-ovn\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-cni-multus\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81facbea-5b6a-4ce5-a032-14c36a240349-tmp\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-var-lib-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375900 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bzbzj\"" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-registration-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.376008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.375979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxxx7\" (UniqueName: \"kubernetes.io/projected/170b29a8-6051-453e-946c-6868a305f89a-kube-api-access-hxxx7\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.376429 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376040 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-cni-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.376429 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-conf-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.376429 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376114 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc768\" (UniqueName: \"kubernetes.io/projected/81facbea-5b6a-4ce5-a032-14c36a240349-kube-api-access-sc768\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.376429 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-log-socket\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.376429 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.376657 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87c471a8-7ebf-4ce1-b9bc-575f663ba144-iptables-alerter-script\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.376657 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-k8s-cni-cncf-io\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.376657 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-etc-kubernetes\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.376657 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376580 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-systemd\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.376657 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376627 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-systemd-units\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.376908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.376908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-netns\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.376908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.376908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376747 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af89228b-8f74-46bf-a480-99c2e108ed8b-agent-certs\") pod \"konnectivity-agent-csjrc\" (UID: \"af89228b-8f74-46bf-a480-99c2e108ed8b\") " pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:33.376908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376791 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.376908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376828 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp6g6\" (UniqueName: \"kubernetes.io/projected/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-kube-api-access-lp6g6\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.377255 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-cni-bin\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.377255 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.376958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-daemon-config\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.377665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysconfig\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.377766 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.377766 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c471a8-7ebf-4ce1-b9bc-575f663ba144-host-slash\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.377766 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnd2f\" (UniqueName: \"kubernetes.io/projected/87c471a8-7ebf-4ce1-b9bc-575f663ba144-kube-api-access-xnd2f\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.377766 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-system-cni-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.377988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-hostroot\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.377988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-kubernetes\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.377988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-lib-modules\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.377988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377863 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-device-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.377988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-cnibin\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.377988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377910 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-host\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.377988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-ovnkube-config\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.377988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377957 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-ovnkube-script-lib\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.377995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378043 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-cni-binary-copy\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-modprobe-d\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-var-lib-kubelet\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-systemd\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/170b29a8-6051-453e-946c-6868a305f89a-hosts-file\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-slash\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-cni-bin\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-socket-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-sys-fs\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-system-cni-dir\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/170b29a8-6051-453e-946c-6868a305f89a-tmp-dir\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.378363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378364 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-kubelet\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.379226 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378389 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-sys\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.379226 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.378413 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-kubelet\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.383674 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.383653 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 15:17:33.406049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.406019 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4jqmv" Jun 11 15:17:33.417722 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.417647 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4jqmv" Jun 11 15:17:33.467506 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.467472 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 15:17:33.479184 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d18494eb-fd32-4d7c-b051-4f1b515de240-ovn-node-metrics-cert\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.479184 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479195 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zlct\" (UniqueName: \"kubernetes.io/projected/d18494eb-fd32-4d7c-b051-4f1b515de240-kube-api-access-6zlct\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.479575 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479545 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q9d2\" (UniqueName: \"kubernetes.io/projected/905a9018-eb8e-41f3-9195-41afce5bc689-kube-api-access-4q9d2\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.479697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-os-release\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.479697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479607 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 15:17:33.479697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-run\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.479697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-cni-netd\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.479697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-env-overrides\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.479697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cnibin\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479704 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-os-release\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479724 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-multus-certs\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-os-release\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysctl-d\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479811 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-etc-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479890 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysctl-d\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-ovn\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-run\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.479962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-os-release\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-cni-multus\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480006 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-multus-certs\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.480024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cnibin\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480046 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-etc-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-cni-netd\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81facbea-5b6a-4ce5-a032-14c36a240349-tmp\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480084 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-ovn\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-var-lib-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480121 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-registration-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480124 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-cni-multus\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480165 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-var-lib-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-dbus\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480201 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxxx7\" (UniqueName: \"kubernetes.io/projected/170b29a8-6051-453e-946c-6868a305f89a-kube-api-access-hxxx7\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-cni-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-registration-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480289 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-cni-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480296 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-etc-selinux\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-conf-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.480562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480322 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-env-overrides\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc768\" (UniqueName: \"kubernetes.io/projected/81facbea-5b6a-4ce5-a032-14c36a240349-kube-api-access-sc768\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-log-socket\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgg2w\" (UniqueName: \"kubernetes.io/projected/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-kube-api-access-zgg2w\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480430 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-log-socket\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480393 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-conf-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87c471a8-7ebf-4ce1-b9bc-575f663ba144-iptables-alerter-script\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-k8s-cni-cncf-io\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-run-ovn-kubernetes\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480494 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-etc-kubernetes\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-k8s-cni-cncf-io\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480540 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-etc-kubernetes\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480566 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-systemd\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-systemd-units\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480636 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-netns\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.481346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-systemd-units\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-systemd\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480740 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-run-netns\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480690 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af89228b-8f74-46bf-a480-99c2e108ed8b-agent-certs\") pod \"konnectivity-agent-csjrc\" (UID: \"af89228b-8f74-46bf-a480-99c2e108ed8b\") " pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp6g6\" (UniqueName: \"kubernetes.io/projected/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-kube-api-access-lp6g6\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-cni-bin\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-daemon-config\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480957 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysconfig\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480964 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87c471a8-7ebf-4ce1-b9bc-575f663ba144-iptables-alerter-script\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.480981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-kubelet-config\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c471a8-7ebf-4ce1-b9bc-575f663ba144-host-slash\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnd2f\" (UniqueName: \"kubernetes.io/projected/87c471a8-7ebf-4ce1-b9bc-575f663ba144-kube-api-access-xnd2f\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.482178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481076 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-system-cni-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-hostroot\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-kubernetes\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-lib-modules\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-device-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481189 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/905a9018-eb8e-41f3-9195-41afce5bc689-host\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-cnibin\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-cni-bin\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-host\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481265 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-ovnkube-config\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481289 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-ovnkube-script-lib\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481315 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-cni-binary-copy\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-modprobe-d\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481408 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-var-lib-kubelet\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481433 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-systemd\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/170b29a8-6051-453e-946c-6868a305f89a-hosts-file\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-slash\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.482933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-cni-bin\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-socket-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481575 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-sys-fs\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-system-cni-dir\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481650 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481701 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/170b29a8-6051-453e-946c-6868a305f89a-tmp-dir\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481722 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c471a8-7ebf-4ce1-b9bc-575f663ba144-host-slash\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481727 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-kubelet\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-sys\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-daemon-config\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-kubelet\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/905a9018-eb8e-41f3-9195-41afce5bc689-serviceca\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481878 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-host-var-lib-kubelet\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfssn\" (UniqueName: \"kubernetes.io/projected/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-kube-api-access-mfssn\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481921 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.483845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481947 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af89228b-8f74-46bf-a480-99c2e108ed8b-konnectivity-ca\") pod \"konnectivity-agent-csjrc\" (UID: \"af89228b-8f74-46bf-a480-99c2e108ed8b\") " pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-system-cni-dir\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482029 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/170b29a8-6051-453e-946c-6868a305f89a-tmp-dir\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-socket-dir-parent\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482082 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysconfig\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysctl-conf\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81facbea-5b6a-4ce5-a032-14c36a240349-etc-tuned\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-sys\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-run-netns\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482157 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-node-log\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vshq\" (UniqueName: \"kubernetes.io/projected/3764e623-e2d7-481b-8a42-3468c6646be7-kube-api-access-2vshq\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482191 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-sysctl-conf\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-hostroot\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482281 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-modprobe-d\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482281 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-etc-kubernetes\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482338 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-var-lib-kubelet\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.484637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482363 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-lib-modules\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482403 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-systemd\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-device-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af89228b-8f74-46bf-a480-99c2e108ed8b-konnectivity-ca\") pod \"konnectivity-agent-csjrc\" (UID: \"af89228b-8f74-46bf-a480-99c2e108ed8b\") " pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482464 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/170b29a8-6051-453e-946c-6868a305f89a-hosts-file\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-cnibin\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482506 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-slash\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482549 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-cni-bin\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482665 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-socket-dir\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482717 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3764e623-e2d7-481b-8a42-3468c6646be7-sys-fs\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482755 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-system-cni-dir\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482762 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cni-binary-copy\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482828 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-multus-socket-dir-parent\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482877 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/81facbea-5b6a-4ce5-a032-14c36a240349-host\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-ovnkube-config\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482971 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-node-log\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.482999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d18494eb-fd32-4d7c-b051-4f1b515de240-ovnkube-script-lib\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.483026 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-run-netns\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.485537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.483125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-run-openvswitch\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.486400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.481850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d18494eb-fd32-4d7c-b051-4f1b515de240-host-kubelet\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.486400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.483255 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.486400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.483307 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.486400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.483535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/81facbea-5b6a-4ce5-a032-14c36a240349-tmp\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.486400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.483564 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-cni-binary-copy\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.486400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.483636 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d18494eb-fd32-4d7c-b051-4f1b515de240-ovn-node-metrics-cert\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.486400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.485390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af89228b-8f74-46bf-a480-99c2e108ed8b-agent-certs\") pod \"konnectivity-agent-csjrc\" (UID: \"af89228b-8f74-46bf-a480-99c2e108ed8b\") " pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:33.486400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.485978 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/81facbea-5b6a-4ce5-a032-14c36a240349-etc-tuned\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.490546 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.490241 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:33.490546 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.490264 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:33.490546 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.490278 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vvqtl for pod openshift-network-diagnostics/network-check-target-xq5jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:33.490546 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.490350 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl podName:060a912f-033d-4056-bcfc-8c145ccf6645 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:33.990327144 +0000 UTC m=+3.006478416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vvqtl" (UniqueName: "kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl") pod "network-check-target-xq5jl" (UID: "060a912f-033d-4056-bcfc-8c145ccf6645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:33.490896 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.490814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zlct\" (UniqueName: \"kubernetes.io/projected/d18494eb-fd32-4d7c-b051-4f1b515de240-kube-api-access-6zlct\") pod \"ovnkube-node-hzfnj\" (UID: \"d18494eb-fd32-4d7c-b051-4f1b515de240\") " pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.490954 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.490910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnd2f\" (UniqueName: \"kubernetes.io/projected/87c471a8-7ebf-4ce1-b9bc-575f663ba144-kube-api-access-xnd2f\") pod \"iptables-alerter-tv6dq\" (UID: \"87c471a8-7ebf-4ce1-b9bc-575f663ba144\") " pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.491474 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.491429 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxxx7\" (UniqueName: \"kubernetes.io/projected/170b29a8-6051-453e-946c-6868a305f89a-kube-api-access-hxxx7\") pod \"node-resolver-tk8cn\" (UID: \"170b29a8-6051-453e-946c-6868a305f89a\") " pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.492449 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.492424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc768\" (UniqueName: \"kubernetes.io/projected/81facbea-5b6a-4ce5-a032-14c36a240349-kube-api-access-sc768\") pod \"tuned-26jts\" (UID: \"81facbea-5b6a-4ce5-a032-14c36a240349\") " pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.493446 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.493425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp6g6\" (UniqueName: \"kubernetes.io/projected/ae80713d-fd5a-47d8-ae1d-6619a9710dc5-kube-api-access-lp6g6\") pod \"multus-additional-cni-plugins-r94bg\" (UID: \"ae80713d-fd5a-47d8-ae1d-6619a9710dc5\") " pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.493573 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.493555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfssn\" (UniqueName: \"kubernetes.io/projected/34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea-kube-api-access-mfssn\") pod \"multus-64bvv\" (UID: \"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea\") " pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.494015 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.493994 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vshq\" (UniqueName: \"kubernetes.io/projected/3764e623-e2d7-481b-8a42-3468c6646be7-kube-api-access-2vshq\") pod \"aws-ebs-csi-driver-node-vvwc6\" (UID: \"3764e623-e2d7-481b-8a42-3468c6646be7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.583180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583138 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:33.583350 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/905a9018-eb8e-41f3-9195-41afce5bc689-serviceca\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.583350 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q9d2\" (UniqueName: \"kubernetes.io/projected/905a9018-eb8e-41f3-9195-41afce5bc689-kube-api-access-4q9d2\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.583350 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-dbus\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.583350 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgg2w\" (UniqueName: \"kubernetes.io/projected/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-kube-api-access-zgg2w\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:33.583350 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.583306 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:33.583635 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.583394 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:33.583635 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.583401 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:34.083378119 +0000 UTC m=+3.099529378 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:33.583635 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:33.583462 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret podName:43b712bb-ebe7-41d5-96f7-6fe84649c4fc nodeName:}" failed. No retries permitted until 2026-06-11 15:17:34.083444728 +0000 UTC m=+3.099595984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret") pod "global-pull-secret-syncer-r8rd8" (UID: "43b712bb-ebe7-41d5-96f7-6fe84649c4fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:33.583635 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.583635 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583626 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-kubelet-config\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.583905 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/905a9018-eb8e-41f3-9195-41afce5bc689-host\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.583905 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583709 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-dbus\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.583905 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583745 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/905a9018-eb8e-41f3-9195-41afce5bc689-host\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.583905 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-kubelet-config\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:33.584083 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.583924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/905a9018-eb8e-41f3-9195-41afce5bc689-serviceca\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.594082 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.594022 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q9d2\" (UniqueName: \"kubernetes.io/projected/905a9018-eb8e-41f3-9195-41afce5bc689-kube-api-access-4q9d2\") pod \"node-ca-nwhjd\" (UID: \"905a9018-eb8e-41f3-9195-41afce5bc689\") " pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.594233 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.594104 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgg2w\" (UniqueName: \"kubernetes.io/projected/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-kube-api-access-zgg2w\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:33.670549 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.670519 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26jts" Jun 11 15:17:33.684053 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.684027 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tv6dq" Jun 11 15:17:33.693597 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.693572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:33.700386 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.700359 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tk8cn" Jun 11 15:17:33.709061 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.709031 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" Jun 11 15:17:33.717655 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.717623 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-64bvv" Jun 11 15:17:33.726369 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.726344 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:33.734930 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.734908 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r94bg" Jun 11 15:17:33.741619 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.741599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nwhjd" Jun 11 15:17:33.847562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:33.847527 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:34.087609 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.087574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:34.087825 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.087623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:34.087825 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.087677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:34.087825 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.087766 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:34.087825 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.087796 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:34.087825 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.087806 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:34.087825 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.087828 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vvqtl for pod openshift-network-diagnostics/network-check-target-xq5jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:34.088109 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.087796 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:34.088109 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.087866 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:35.087845936 +0000 UTC m=+4.103997191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:34.088109 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.087939 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl podName:060a912f-033d-4056-bcfc-8c145ccf6645 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:35.087918877 +0000 UTC m=+4.104070139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvqtl" (UniqueName: "kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl") pod "network-check-target-xq5jl" (UID: "060a912f-033d-4056-bcfc-8c145ccf6645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:34.088109 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.087958 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret podName:43b712bb-ebe7-41d5-96f7-6fe84649c4fc nodeName:}" failed. No retries permitted until 2026-06-11 15:17:35.087948573 +0000 UTC m=+4.104099832 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret") pod "global-pull-secret-syncer-r8rd8" (UID: "43b712bb-ebe7-41d5-96f7-6fe84649c4fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:34.324897 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.324850 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3764e623_e2d7_481b_8a42_3468c6646be7.slice/crio-46faeea473b93450e1c545eb4accc477149f1b026a5b80c64282225888122365 WatchSource:0}: Error finding container 46faeea473b93450e1c545eb4accc477149f1b026a5b80c64282225888122365: Status 404 returned error can't find the container with id 46faeea473b93450e1c545eb4accc477149f1b026a5b80c64282225888122365 Jun 11 15:17:34.331881 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.331855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18494eb_fd32_4d7c_b051_4f1b515de240.slice/crio-c15d046fe74277811e6bdc18ec4d4664964d38a16332b29c376a4d016ea582bd WatchSource:0}: Error finding container c15d046fe74277811e6bdc18ec4d4664964d38a16332b29c376a4d016ea582bd: Status 404 returned error can't find the container with id c15d046fe74277811e6bdc18ec4d4664964d38a16332b29c376a4d016ea582bd Jun 11 15:17:34.333819 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.333751 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf89228b_8f74_46bf_a480_99c2e108ed8b.slice/crio-bac459ea49545e79aed1fbe882b2597266aa61d23c1fc7b0bde7bfb49d0c202b WatchSource:0}: Error finding container bac459ea49545e79aed1fbe882b2597266aa61d23c1fc7b0bde7bfb49d0c202b: Status 404 returned error can't find the container with id bac459ea49545e79aed1fbe882b2597266aa61d23c1fc7b0bde7bfb49d0c202b Jun 11 15:17:34.334270 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.334244 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c471a8_7ebf_4ce1_b9bc_575f663ba144.slice/crio-95550d4ab245cc609a31591f336723f5bec330d8668c93ed3b6c5e557a881d29 WatchSource:0}: Error finding container 95550d4ab245cc609a31591f336723f5bec330d8668c93ed3b6c5e557a881d29: Status 404 returned error can't find the container with id 95550d4ab245cc609a31591f336723f5bec330d8668c93ed3b6c5e557a881d29 Jun 11 15:17:34.338239 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.338214 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905a9018_eb8e_41f3_9195_41afce5bc689.slice/crio-de4f97b224d8a1d840fb4876809d71d9d55f0768968da39d62cba9680a6441a7 WatchSource:0}: Error finding container de4f97b224d8a1d840fb4876809d71d9d55f0768968da39d62cba9680a6441a7: Status 404 returned error can't find the container with id de4f97b224d8a1d840fb4876809d71d9d55f0768968da39d62cba9680a6441a7 Jun 11 15:17:34.339649 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.339560 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170b29a8_6051_453e_946c_6868a305f89a.slice/crio-ce2f0cfcb47102f1dffbec015dc24343958e61b99e1693b6fe3a6f5ac9a77eb1 WatchSource:0}: Error finding container ce2f0cfcb47102f1dffbec015dc24343958e61b99e1693b6fe3a6f5ac9a77eb1: Status 404 returned error can't find the container with id ce2f0cfcb47102f1dffbec015dc24343958e61b99e1693b6fe3a6f5ac9a77eb1 Jun 11 15:17:34.341627 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.341482 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81facbea_5b6a_4ce5_a032_14c36a240349.slice/crio-6d055238d87ea3d7d1b4044ecfdee76706fe38c9b4f53e9cc9defe6cd3b50e44 WatchSource:0}: Error finding container 6d055238d87ea3d7d1b4044ecfdee76706fe38c9b4f53e9cc9defe6cd3b50e44: Status 404 returned error can't find the container with id 6d055238d87ea3d7d1b4044ecfdee76706fe38c9b4f53e9cc9defe6cd3b50e44 Jun 11 15:17:34.343053 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.343027 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae80713d_fd5a_47d8_ae1d_6619a9710dc5.slice/crio-c4735b284d6f253a81a9011c7de17fbba51137a634a2ddc78405bb79f3a1ca46 WatchSource:0}: Error finding container c4735b284d6f253a81a9011c7de17fbba51137a634a2ddc78405bb79f3a1ca46: Status 404 returned error can't find the container with id c4735b284d6f253a81a9011c7de17fbba51137a634a2ddc78405bb79f3a1ca46 Jun 11 15:17:34.343726 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:17:34.343656 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ed6f5b_c5a3_48bd_81c3_e2fc22f8d9ea.slice/crio-2645a90097d5cc441a26265fed34b502030c592ae654bfb0386a070e6e589814 WatchSource:0}: Error finding container 2645a90097d5cc441a26265fed34b502030c592ae654bfb0386a070e6e589814: Status 404 returned error can't find the container with id 2645a90097d5cc441a26265fed34b502030c592ae654bfb0386a070e6e589814 Jun 11 15:17:34.422560 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.422527 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:12:33 +0000 UTC" deadline="2028-02-18 01:35:03.436564876 +0000 UTC" Jun 11 15:17:34.422560 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.422559 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14794h17m29.014010329s" Jun 11 15:17:34.434087 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.434055 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:34.434195 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.434155 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:34.434195 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.434184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:34.434288 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:34.434230 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:34.442477 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.442451 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-csjrc" event={"ID":"af89228b-8f74-46bf-a480-99c2e108ed8b","Type":"ContainerStarted","Data":"bac459ea49545e79aed1fbe882b2597266aa61d23c1fc7b0bde7bfb49d0c202b"} Jun 11 15:17:34.447075 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.447048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" event={"ID":"6433c8eee751c3d2240369462b2d4f86","Type":"ContainerStarted","Data":"d8511bef83c6be23517bb512d2c6c2f885840bffe26d578772f13f6ac354705b"} Jun 11 15:17:34.449010 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.448988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r94bg" event={"ID":"ae80713d-fd5a-47d8-ae1d-6619a9710dc5","Type":"ContainerStarted","Data":"c4735b284d6f253a81a9011c7de17fbba51137a634a2ddc78405bb79f3a1ca46"} Jun 11 15:17:34.450797 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.450759 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-64bvv" event={"ID":"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea","Type":"ContainerStarted","Data":"2645a90097d5cc441a26265fed34b502030c592ae654bfb0386a070e6e589814"} Jun 11 15:17:34.451961 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.451937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26jts" event={"ID":"81facbea-5b6a-4ce5-a032-14c36a240349","Type":"ContainerStarted","Data":"6d055238d87ea3d7d1b4044ecfdee76706fe38c9b4f53e9cc9defe6cd3b50e44"} Jun 11 15:17:34.453046 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.453024 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tk8cn" event={"ID":"170b29a8-6051-453e-946c-6868a305f89a","Type":"ContainerStarted","Data":"ce2f0cfcb47102f1dffbec015dc24343958e61b99e1693b6fe3a6f5ac9a77eb1"} Jun 11 15:17:34.454055 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.454034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tv6dq" event={"ID":"87c471a8-7ebf-4ce1-b9bc-575f663ba144","Type":"ContainerStarted","Data":"95550d4ab245cc609a31591f336723f5bec330d8668c93ed3b6c5e557a881d29"} Jun 11 15:17:34.455108 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.455090 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"c15d046fe74277811e6bdc18ec4d4664964d38a16332b29c376a4d016ea582bd"} Jun 11 15:17:34.456142 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.456123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" event={"ID":"3764e623-e2d7-481b-8a42-3468c6646be7","Type":"ContainerStarted","Data":"46faeea473b93450e1c545eb4accc477149f1b026a5b80c64282225888122365"} Jun 11 15:17:34.457340 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.457314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nwhjd" event={"ID":"905a9018-eb8e-41f3-9195-41afce5bc689","Type":"ContainerStarted","Data":"de4f97b224d8a1d840fb4876809d71d9d55f0768968da39d62cba9680a6441a7"} Jun 11 15:17:34.465231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.465181 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-103.ec2.internal" podStartSLOduration=2.465164455 podStartE2EDuration="2.465164455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:34.46507249 +0000 UTC m=+3.481223766" watchObservedRunningTime="2026-06-11 15:17:34.465164455 +0000 UTC m=+3.481315731" Jun 11 15:17:34.511370 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:34.511312 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 15:17:35.094604 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:35.094560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:35.094840 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:35.094623 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:35.094840 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:35.094676 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:35.094840 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.094821 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:35.095020 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.094884 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret podName:43b712bb-ebe7-41d5-96f7-6fe84649c4fc nodeName:}" failed. No retries permitted until 2026-06-11 15:17:37.094866426 +0000 UTC m=+6.111017683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret") pod "global-pull-secret-syncer-r8rd8" (UID: "43b712bb-ebe7-41d5-96f7-6fe84649c4fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:35.095512 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.095314 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:35.095512 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.095336 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:35.095512 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.095350 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vvqtl for pod openshift-network-diagnostics/network-check-target-xq5jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:35.095512 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.095392 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl podName:060a912f-033d-4056-bcfc-8c145ccf6645 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:37.095378668 +0000 UTC m=+6.111529927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvqtl" (UniqueName: "kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl") pod "network-check-target-xq5jl" (UID: "060a912f-033d-4056-bcfc-8c145ccf6645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:35.095512 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.095448 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:35.095512 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.095478 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:37.095467603 +0000 UTC m=+6.111618859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:35.424228 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:35.424064 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 15:12:33 +0000 UTC" deadline="2028-01-11 12:25:06.031774679 +0000 UTC" Jun 11 15:17:35.424228 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:35.424123 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13893h7m30.607655252s" Jun 11 15:17:35.436334 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:35.436304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:35.436534 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:35.436430 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:35.468448 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:35.467413 2574 generic.go:356] "Generic (PLEG): container finished" podID="afbbb6aa168f6c7fe506418ce73f5b8e" containerID="65af3b422f9dda91c663258fc03e30dfb834317fd5425cfc386b772f8d09c72a" exitCode=0 Jun 11 15:17:35.468448 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:35.468390 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" event={"ID":"afbbb6aa168f6c7fe506418ce73f5b8e","Type":"ContainerDied","Data":"65af3b422f9dda91c663258fc03e30dfb834317fd5425cfc386b772f8d09c72a"} Jun 11 15:17:36.434515 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:36.433817 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:36.434515 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:36.433958 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:36.434515 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:36.434347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:36.434515 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:36.434447 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:36.511367 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:36.511331 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" event={"ID":"afbbb6aa168f6c7fe506418ce73f5b8e","Type":"ContainerStarted","Data":"4aa39426d369ba0c8b3e071ac1cb0d1b1bd12de5ceaff8339c4835416494f163"} Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:37.112323 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:37.112403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:37.112443 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.112574 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.112592 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.112607 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vvqtl for pod openshift-network-diagnostics/network-check-target-xq5jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.112663 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl podName:060a912f-033d-4056-bcfc-8c145ccf6645 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:41.112645988 +0000 UTC m=+10.128797240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvqtl" (UniqueName: "kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl") pod "network-check-target-xq5jl" (UID: "060a912f-033d-4056-bcfc-8c145ccf6645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.113071 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.113116 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:41.113101765 +0000 UTC m=+10.129253022 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.113187 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:37.113261 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.113223 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret podName:43b712bb-ebe7-41d5-96f7-6fe84649c4fc nodeName:}" failed. No retries permitted until 2026-06-11 15:17:41.113210989 +0000 UTC m=+10.129362243 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret") pod "global-pull-secret-syncer-r8rd8" (UID: "43b712bb-ebe7-41d5-96f7-6fe84649c4fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:37.434088 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:37.434051 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:37.434273 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:37.434191 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:38.433867 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:38.433818 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:38.434329 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:38.433946 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:38.434329 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:38.434034 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:38.434329 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:38.434117 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:39.434489 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:39.434343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:39.434489 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:39.434478 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:40.433999 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:40.433964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:40.434184 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:40.434103 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:40.434256 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:40.434192 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:40.434342 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:40.434316 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:41.147435 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:41.147390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:41.147448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:41.147484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.147554 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.147585 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.147604 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.147624 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.147637 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vvqtl for pod openshift-network-diagnostics/network-check-target-xq5jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.147624 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret podName:43b712bb-ebe7-41d5-96f7-6fe84649c4fc nodeName:}" failed. No retries permitted until 2026-06-11 15:17:49.147606245 +0000 UTC m=+18.163757509 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret") pod "global-pull-secret-syncer-r8rd8" (UID: "43b712bb-ebe7-41d5-96f7-6fe84649c4fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.147679 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:49.147668187 +0000 UTC m=+18.163819455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:41.147890 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.147698 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl podName:060a912f-033d-4056-bcfc-8c145ccf6645 nodeName:}" failed. No retries permitted until 2026-06-11 15:17:49.147689994 +0000 UTC m=+18.163841254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvqtl" (UniqueName: "kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl") pod "network-check-target-xq5jl" (UID: "060a912f-033d-4056-bcfc-8c145ccf6645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:41.433880 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:41.433853 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:41.434055 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:41.433995 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:42.433426 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:42.433399 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:42.433426 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:42.433418 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:42.434149 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:42.433533 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:42.434149 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:42.433600 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:43.434460 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:43.434423 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:43.434925 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:43.434557 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:44.434351 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:44.434324 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:44.434527 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:44.434333 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:44.434527 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:44.434456 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:44.434956 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:44.434548 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:45.434251 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:45.434221 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:45.434439 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:45.434340 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:46.433452 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:46.433420 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:46.433940 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:46.433552 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:46.433940 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:46.433588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:46.433940 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:46.433691 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:47.437201 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:47.437172 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:47.437607 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:47.437276 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:48.434231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:48.434033 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:48.434421 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:48.434033 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:48.434421 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:48.434326 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:48.434421 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:48.434381 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:49.212178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:49.212147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:49.212190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:49.212220 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.212317 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.212319 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.212333 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.212350 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.212361 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vvqtl for pod openshift-network-diagnostics/network-check-target-xq5jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.212384 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:05.212365725 +0000 UTC m=+34.228516995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.212400 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl podName:060a912f-033d-4056-bcfc-8c145ccf6645 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:05.212391486 +0000 UTC m=+34.228542742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvqtl" (UniqueName: "kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl") pod "network-check-target-xq5jl" (UID: "060a912f-033d-4056-bcfc-8c145ccf6645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:17:49.212653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.212416 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret podName:43b712bb-ebe7-41d5-96f7-6fe84649c4fc nodeName:}" failed. No retries permitted until 2026-06-11 15:18:05.212408823 +0000 UTC m=+34.228560075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret") pod "global-pull-secret-syncer-r8rd8" (UID: "43b712bb-ebe7-41d5-96f7-6fe84649c4fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:17:49.434215 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:49.434181 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:49.434377 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:49.434297 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:50.433869 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:50.433838 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:50.434400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:50.433844 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:50.434400 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:50.433967 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:50.434400 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:50.434017 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:51.434954 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:51.434918 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:51.435788 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:51.435019 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:52.433752 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:52.433722 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:52.433903 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:52.433883 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:52.433966 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:52.433932 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:52.434042 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:52.434017 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:53.434319 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.434083 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:53.435037 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:53.434418 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:53.545332 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.545291 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nwhjd" event={"ID":"905a9018-eb8e-41f3-9195-41afce5bc689","Type":"ContainerStarted","Data":"5f904fd94179e9011518bc0f96f066fdb5f14603f09f663f2c89c21b8d047515"} Jun 11 15:17:53.546593 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.546573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-csjrc" event={"ID":"af89228b-8f74-46bf-a480-99c2e108ed8b","Type":"ContainerStarted","Data":"4dfe489d13e433d296334293400ed5d54f1d7abf46d51880d4edbae6868d6cdb"} Jun 11 15:17:53.547904 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.547883 2574 generic.go:356] "Generic (PLEG): container finished" podID="ae80713d-fd5a-47d8-ae1d-6619a9710dc5" containerID="f5ff8e5574120e0069af787f224abe23e6e93f652dac8bc562df0922194d5748" exitCode=0 Jun 11 15:17:53.547985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.547958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r94bg" event={"ID":"ae80713d-fd5a-47d8-ae1d-6619a9710dc5","Type":"ContainerDied","Data":"f5ff8e5574120e0069af787f224abe23e6e93f652dac8bc562df0922194d5748"} Jun 11 15:17:53.549368 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.549344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-64bvv" event={"ID":"34ed6f5b-c5a3-48bd-81c3-e2fc22f8d9ea","Type":"ContainerStarted","Data":"aa15e92ef5a7a3c275a772b08268c94d82615e180a65d116555396517fdc689e"} Jun 11 15:17:53.550835 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.550707 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26jts" event={"ID":"81facbea-5b6a-4ce5-a032-14c36a240349","Type":"ContainerStarted","Data":"422cb3486f64128b84aaf8c51abed494f3ed8efd17e6f4f8ba5d0763e07a3179"} Jun 11 15:17:53.551957 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.551929 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tk8cn" event={"ID":"170b29a8-6051-453e-946c-6868a305f89a","Type":"ContainerStarted","Data":"ea0b8b81451fceb2e152d58b327dd5b39966f046336777e1108cdd3dedde7021"} Jun 11 15:17:53.554748 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.554725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"8b64ac381b5c4de5c481b73c47708db7e7666396935a380a45ef8a872728a309"} Jun 11 15:17:53.554844 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.554811 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"71fdb9b3c3daf038bdbdfe6738a19b311d31f77f28f8e7abbcdf551dd2f7c01b"} Jun 11 15:17:53.554890 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.554852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"257757a3cca4f12f4d6b5cdf6bf415f29d3a5e38213df39df986961e424d70cf"} Jun 11 15:17:53.554923 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.554896 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"2545d4f504792abc45f7dc7ee60104f504fc27c14312e19fe0bd56a8c33f50e2"} Jun 11 15:17:53.554965 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.554936 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"149d5a42fc5e77f420efc92076171137be065ce954b7b0953335c75755ea3f00"} Jun 11 15:17:53.555007 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.554975 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"918743f2a0695f5653fd0fb50fa13426d2276fb43d4abedbb0601622384ca49d"} Jun 11 15:17:53.556029 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.556012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" event={"ID":"3764e623-e2d7-481b-8a42-3468c6646be7","Type":"ContainerStarted","Data":"8d3ec897012bdea9584555ed6de6cdfe894e42f84a19e1f98b2f73a5660cb116"} Jun 11 15:17:53.570481 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.570447 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-103.ec2.internal" podStartSLOduration=21.570436323 podStartE2EDuration="21.570436323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:36.531149679 +0000 UTC m=+5.547300953" watchObservedRunningTime="2026-06-11 15:17:53.570436323 +0000 UTC m=+22.586587597" Jun 11 15:17:53.594494 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.594451 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nwhjd" podStartSLOduration=4.3079327339999995 podStartE2EDuration="22.59443434s" totalImagesPullingTime="18.286501606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:53.570843442 +0000 UTC m=+22.586994717" watchObservedRunningTime="2026-06-11 15:17:53.59443434 +0000 UTC m=+22.610585616" Jun 11 15:17:53.610751 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.610710 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26jts" podStartSLOduration=4.324316298 podStartE2EDuration="22.61069343s" totalImagesPullingTime="18.286377132s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:53.609914556 +0000 UTC m=+22.626065831" watchObservedRunningTime="2026-06-11 15:17:53.61069343 +0000 UTC m=+22.626844707" Jun 11 15:17:53.629898 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.629853 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-64bvv" podStartSLOduration=4.32930377 podStartE2EDuration="22.629844653s" totalImagesPullingTime="18.300540883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:53.629756268 +0000 UTC m=+22.645907520" watchObservedRunningTime="2026-06-11 15:17:53.629844653 +0000 UTC m=+22.645995929" Jun 11 15:17:53.647097 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.647066 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-tk8cn" podStartSLOduration=4.389292421 podStartE2EDuration="22.647055503s" totalImagesPullingTime="18.257763082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:53.646790251 +0000 UTC m=+22.662941524" watchObservedRunningTime="2026-06-11 15:17:53.647055503 +0000 UTC m=+22.663206776" Jun 11 15:17:53.669664 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.669631 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-csjrc" podStartSLOduration=9.082135065 podStartE2EDuration="22.669620777s" totalImagesPullingTime="13.587485712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:53.667125472 +0000 UTC m=+22.683276757" watchObservedRunningTime="2026-06-11 15:17:53.669620777 +0000 UTC m=+22.685772052" Jun 11 15:17:53.822477 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:53.822453 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 15:17:54.431917 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.431806 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T15:17:53.822474626Z","UUID":"f176bfc1-870b-4901-8efc-53ec617af3ab","Handler":null,"Name":"","Endpoint":""} Jun 11 15:17:54.433943 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.433517 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 15:17:54.433943 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.433559 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 15:17:54.433943 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.433569 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:54.433943 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.433571 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:54.433943 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:54.433688 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:54.433943 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:54.433804 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:54.559786 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.559739 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tv6dq" event={"ID":"87c471a8-7ebf-4ce1-b9bc-575f663ba144","Type":"ContainerStarted","Data":"cc9b131070011aed0d10a5436dfd1c3bd354d091e4fea01dcb6514f0a181b151"} Jun 11 15:17:54.562214 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.562192 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" event={"ID":"3764e623-e2d7-481b-8a42-3468c6646be7","Type":"ContainerStarted","Data":"39395791d782fc584ce60697715d7e09114b2e12ab10cfa4aac99c59cda405b4"} Jun 11 15:17:54.562332 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.562231 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" event={"ID":"3764e623-e2d7-481b-8a42-3468c6646be7","Type":"ContainerStarted","Data":"101cee32a62743784e13811fc6ef3e50f8fb6ebe5fb0ee9b559390edf1450d3b"} Jun 11 15:17:54.596241 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:54.596192 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tv6dq" podStartSLOduration=5.308832909 podStartE2EDuration="23.596174645s" totalImagesPullingTime="18.287341736s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:54.57467702 +0000 UTC m=+23.590828297" watchObservedRunningTime="2026-06-11 15:17:54.596174645 +0000 UTC m=+23.612325920" Jun 11 15:17:55.434054 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:55.434023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:55.434220 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:55.434146 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:55.566978 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:55.566943 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"f15e73e8924863d918a53bedf635afb7543b741bd0c0b5c38649cf3c6133e5c6"} Jun 11 15:17:55.808749 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:55.808680 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:55.809371 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:55.809355 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:55.831052 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:55.830993 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-vvwc6" podStartSLOduration=5.029231439 podStartE2EDuration="24.830977557s" totalImagesPullingTime="19.801746118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:54.596983136 +0000 UTC m=+23.613134420" watchObservedRunningTime="2026-06-11 15:17:55.830977557 +0000 UTC m=+24.847128876" Jun 11 15:17:56.433520 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:56.433489 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:56.433520 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:56.433524 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:56.433704 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:56.433608 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:56.433704 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:56.433686 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:56.568846 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:56.568819 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:56.569423 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:56.569353 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-csjrc" Jun 11 15:17:57.433640 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:57.433525 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:57.433741 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:57.433721 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:17:57.574065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:57.573956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" event={"ID":"d18494eb-fd32-4d7c-b051-4f1b515de240","Type":"ContainerStarted","Data":"5730b5e38f312e4b075417f762cd93381798bb764bfe7d25552c0eb5ca7210dd"} Jun 11 15:17:57.613256 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:57.613204 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" podStartSLOduration=8.253369635 podStartE2EDuration="26.613189872s" totalImagesPullingTime="18.359820237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:17:57.612902073 +0000 UTC m=+26.629053347" watchObservedRunningTime="2026-06-11 15:17:57.613189872 +0000 UTC m=+26.629341146" Jun 11 15:17:58.434412 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:58.434376 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:58.434613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:58.434381 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:58.434613 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:58.434515 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:58.434613 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:58.434582 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:58.578305 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:58.578271 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:58.578825 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:58.578354 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:58.578825 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:58.578402 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:58.609876 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:58.609842 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:58.610280 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:58.610258 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:17:59.373824 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:59.373741 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r8rd8"] Jun 11 15:17:59.374027 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:59.373967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:17:59.374110 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:59.374085 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:17:59.376726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:59.376699 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58xmz"] Jun 11 15:17:59.376871 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:59.376823 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:17:59.376940 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:59.376923 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:17:59.379877 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:59.379859 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xq5jl"] Jun 11 15:17:59.379967 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:17:59.379950 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:17:59.380061 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:17:59.380038 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:18:00.583471 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:00.583284 2574 generic.go:356] "Generic (PLEG): container finished" podID="ae80713d-fd5a-47d8-ae1d-6619a9710dc5" containerID="9e5455ae0a7ecec053f03cddf776a20c8e291ad29ff976ce3a05cf3de1a622ad" exitCode=0 Jun 11 15:18:00.583993 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:00.583329 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r94bg" event={"ID":"ae80713d-fd5a-47d8-ae1d-6619a9710dc5","Type":"ContainerDied","Data":"9e5455ae0a7ecec053f03cddf776a20c8e291ad29ff976ce3a05cf3de1a622ad"} Jun 11 15:18:01.438121 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:01.438095 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:18:01.438247 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:01.438187 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:18:01.438291 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:01.438239 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:18:01.438291 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:01.438271 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:18:01.438392 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:01.438297 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:18:01.438392 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:01.438354 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:18:02.589233 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:02.589198 2574 generic.go:356] "Generic (PLEG): container finished" podID="ae80713d-fd5a-47d8-ae1d-6619a9710dc5" containerID="b698bb93d0be8074c94566e691e398e81b27f260cf2d24d5a616d302cad7ff5b" exitCode=0 Jun 11 15:18:02.589891 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:02.589243 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r94bg" event={"ID":"ae80713d-fd5a-47d8-ae1d-6619a9710dc5","Type":"ContainerDied","Data":"b698bb93d0be8074c94566e691e398e81b27f260cf2d24d5a616d302cad7ff5b"} Jun 11 15:18:03.434213 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:03.434181 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:18:03.434387 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:03.434184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:18:03.434387 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:03.434315 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r8rd8" podUID="43b712bb-ebe7-41d5-96f7-6fe84649c4fc" Jun 11 15:18:03.434387 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:03.434195 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:18:03.434547 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:03.434344 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xq5jl" podUID="060a912f-033d-4056-bcfc-8c145ccf6645" Jun 11 15:18:03.434547 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:03.434429 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:18:04.594727 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:04.594692 2574 generic.go:356] "Generic (PLEG): container finished" podID="ae80713d-fd5a-47d8-ae1d-6619a9710dc5" containerID="a2f34eae1f92a3d0d988615d68b72efcb4fdcf856a4bc426c7522a205ec134fb" exitCode=0 Jun 11 15:18:04.595318 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:04.594731 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r94bg" event={"ID":"ae80713d-fd5a-47d8-ae1d-6619a9710dc5","Type":"ContainerDied","Data":"a2f34eae1f92a3d0d988615d68b72efcb4fdcf856a4bc426c7522a205ec134fb"} Jun 11 15:18:05.240200 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.240176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:18:05.240325 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.240213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:18:05.240325 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.240273 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:18:05.240432 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.240326 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 15:18:05.240432 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.240368 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 15:18:05.240432 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.240389 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret podName:43b712bb-ebe7-41d5-96f7-6fe84649c4fc nodeName:}" failed. No retries permitted until 2026-06-11 15:18:37.240371197 +0000 UTC m=+66.256522455 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret") pod "global-pull-secret-syncer-r8rd8" (UID: "43b712bb-ebe7-41d5-96f7-6fe84649c4fc") : object "kube-system"/"original-pull-secret" not registered Jun 11 15:18:05.240432 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.240392 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 15:18:05.240432 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.240395 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:18:05.240432 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.240407 2574 projected.go:196] Error preparing data for projected volume kube-api-access-vvqtl for pod openshift-network-diagnostics/network-check-target-xq5jl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:18:05.240653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.240455 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:37.240437262 +0000 UTC m=+66.256588521 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 15:18:05.240653 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.240474 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl podName:060a912f-033d-4056-bcfc-8c145ccf6645 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:37.240464116 +0000 UTC m=+66.256615379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vvqtl" (UniqueName: "kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl") pod "network-check-target-xq5jl" (UID: "060a912f-033d-4056-bcfc-8c145ccf6645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 15:18:05.280661 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.280637 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-103.ec2.internal" event="NodeReady" Jun 11 15:18:05.280812 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.280795 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 15:18:05.319207 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.319177 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-57f95779c-xjscb"] Jun 11 15:18:05.339365 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.339339 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qq7h7"] Jun 11 15:18:05.339522 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.339464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.341752 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.341496 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 15:18:05.341752 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.341558 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 15:18:05.341752 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.341577 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 15:18:05.341752 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.341630 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cspmp\"" Jun 11 15:18:05.347334 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.347287 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 15:18:05.355350 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.355330 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vdf75"] Jun 11 15:18:05.355500 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.355485 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.357671 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.357620 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 15:18:05.357792 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.357700 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jps6d\"" Jun 11 15:18:05.357792 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.357627 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 15:18:05.377445 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.377425 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f95779c-xjscb"] Jun 11 15:18:05.377555 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.377457 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qq7h7"] Jun 11 15:18:05.377555 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.377483 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vdf75"] Jun 11 15:18:05.377555 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.377552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vdf75" Jun 11 15:18:05.379837 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.379817 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 15:18:05.379941 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.379836 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g6rph\"" Jun 11 15:18:05.379941 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.379819 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 15:18:05.379941 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.379888 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 15:18:05.433485 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.433462 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:18:05.433610 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.433470 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:18:05.433610 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.433583 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:18:05.436157 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.436137 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92qml\"" Jun 11 15:18:05.436616 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.436374 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:18:05.436616 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.436422 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cmv6\"" Jun 11 15:18:05.436616 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.436433 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:18:05.436616 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.436450 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:18:05.436616 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.436506 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:18:05.441675 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.441763 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.441763 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-image-registry-private-configuration\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.441763 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8zmj\" (UniqueName: \"kubernetes.io/projected/8221e5a8-dc66-4499-a9d7-ac824f4ce656-kube-api-access-c8zmj\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.441945 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-certificates\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.441945 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/190db870-eaf1-40e2-8511-5e2a34a4b36b-ca-trust-extracted\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.441945 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-bound-sa-token\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.442094 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksdq8\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-kube-api-access-ksdq8\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.442094 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.441966 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8221e5a8-dc66-4499-a9d7-ac824f4ce656-config-volume\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.442094 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.442035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8221e5a8-dc66-4499-a9d7-ac824f4ce656-tmp-dir\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.442224 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.442111 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-installation-pull-secrets\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.442224 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.442140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-trusted-ca\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.543152 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-trusted-ca\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.543316 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543196 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.543316 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.543294 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:18:05.543316 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.543308 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:18:05.543478 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.543380 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:18:06.043360676 +0000 UTC m=+35.059511931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:18:05.543478 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.543478 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543417 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-image-registry-private-configuration\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.543478 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8zmj\" (UniqueName: \"kubernetes.io/projected/8221e5a8-dc66-4499-a9d7-ac824f4ce656-kube-api-access-c8zmj\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.543478 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.543452 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:05.543478 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-certificates\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.543791 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6llr2\" (UniqueName: \"kubernetes.io/projected/c763b42a-b789-418f-947e-24f064579283-kube-api-access-6llr2\") pod \"ingress-canary-vdf75\" (UID: \"c763b42a-b789-418f-947e-24f064579283\") " pod="openshift-ingress-canary/ingress-canary-vdf75" Jun 11 15:18:05.543791 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/190db870-eaf1-40e2-8511-5e2a34a4b36b-ca-trust-extracted\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.543791 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-bound-sa-token\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.543791 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksdq8\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-kube-api-access-ksdq8\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.543791 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8221e5a8-dc66-4499-a9d7-ac824f4ce656-config-volume\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.543791 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8221e5a8-dc66-4499-a9d7-ac824f4ce656-tmp-dir\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.543791 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.543729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c763b42a-b789-418f-947e-24f064579283-cert\") pod \"ingress-canary-vdf75\" (UID: \"c763b42a-b789-418f-947e-24f064579283\") " pod="openshift-ingress-canary/ingress-canary-vdf75" Jun 11 15:18:05.544109 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.544033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/190db870-eaf1-40e2-8511-5e2a34a4b36b-ca-trust-extracted\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.544209 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.544150 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-certificates\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.544209 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.544155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8221e5a8-dc66-4499-a9d7-ac824f4ce656-tmp-dir\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.544209 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:05.544179 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:06.04416665 +0000 UTC m=+35.060317928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:18:05.544209 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.544202 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-trusted-ca\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.544441 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.544227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-installation-pull-secrets\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.544441 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.544287 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8221e5a8-dc66-4499-a9d7-ac824f4ce656-config-volume\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.548451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.548293 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-installation-pull-secrets\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.548551 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.548387 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-image-registry-private-configuration\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.555242 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.555213 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-bound-sa-token\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.555242 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.555231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8zmj\" (UniqueName: \"kubernetes.io/projected/8221e5a8-dc66-4499-a9d7-ac824f4ce656-kube-api-access-c8zmj\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:05.555826 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.555800 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksdq8\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-kube-api-access-ksdq8\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:05.645434 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.645403 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c763b42a-b789-418f-947e-24f064579283-cert\") pod \"ingress-canary-vdf75\" (UID: \"c763b42a-b789-418f-947e-24f064579283\") " pod="openshift-ingress-canary/ingress-canary-vdf75" Jun 11 15:18:05.645924 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.645508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6llr2\" (UniqueName: \"kubernetes.io/projected/c763b42a-b789-418f-947e-24f064579283-kube-api-access-6llr2\") pod \"ingress-canary-vdf75\" (UID: \"c763b42a-b789-418f-947e-24f064579283\") " pod="openshift-ingress-canary/ingress-canary-vdf75" Jun 11 15:18:05.648369 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.648343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c763b42a-b789-418f-947e-24f064579283-cert\") pod \"ingress-canary-vdf75\" (UID: \"c763b42a-b789-418f-947e-24f064579283\") " pod="openshift-ingress-canary/ingress-canary-vdf75" Jun 11 15:18:05.655231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.655207 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6llr2\" (UniqueName: \"kubernetes.io/projected/c763b42a-b789-418f-947e-24f064579283-kube-api-access-6llr2\") pod \"ingress-canary-vdf75\" (UID: \"c763b42a-b789-418f-947e-24f064579283\") " pod="openshift-ingress-canary/ingress-canary-vdf75" Jun 11 15:18:05.686634 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.686575 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vdf75" Jun 11 15:18:05.884177 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:05.884146 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vdf75"] Jun 11 15:18:05.888133 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:18:05.888109 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc763b42a_b789_418f_947e_24f064579283.slice/crio-619a9b9284e7ee1df31e928dd178326ab5ce2ee5ac65b919f7223affb2d7d7b4 WatchSource:0}: Error finding container 619a9b9284e7ee1df31e928dd178326ab5ce2ee5ac65b919f7223affb2d7d7b4: Status 404 returned error can't find the container with id 619a9b9284e7ee1df31e928dd178326ab5ce2ee5ac65b919f7223affb2d7d7b4 Jun 11 15:18:06.049081 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:06.048990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:06.049081 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:06.049036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:06.049291 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:06.049156 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:18:06.049291 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:06.049170 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:06.049291 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:06.049178 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:18:06.049291 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:06.049238 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:07.049219665 +0000 UTC m=+36.065370937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:18:06.049291 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:06.049260 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:18:07.049249754 +0000 UTC m=+36.065401009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:18:06.601414 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:06.601377 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vdf75" event={"ID":"c763b42a-b789-418f-947e-24f064579283","Type":"ContainerStarted","Data":"619a9b9284e7ee1df31e928dd178326ab5ce2ee5ac65b919f7223affb2d7d7b4"} Jun 11 15:18:07.053986 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:07.053945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:07.053986 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:07.053989 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:07.054502 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:07.054104 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:18:07.054502 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:07.054125 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:18:07.054502 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:07.054179 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:07.054502 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:07.054185 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:18:09.054169816 +0000 UTC m=+38.070321074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:18:07.054502 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:07.054254 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:09.054236639 +0000 UTC m=+38.070387897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:18:09.070310 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:09.070270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:09.070310 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:09.070317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:09.070817 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:09.070466 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:09.070817 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:09.070474 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:18:09.070817 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:09.070495 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:18:09.070817 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:09.070535 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:13.070518437 +0000 UTC m=+42.086669693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:18:09.070817 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:09.070558 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:18:13.07054394 +0000 UTC m=+42.086695197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:18:09.613654 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:09.613458 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vdf75" event={"ID":"c763b42a-b789-418f-947e-24f064579283","Type":"ContainerStarted","Data":"a9bb7b293fd6054b433bc2bd1716bed34d23dbd8402cf7e2af6173a223173a74"} Jun 11 15:18:10.618702 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:10.618666 2574 generic.go:356] "Generic (PLEG): container finished" podID="ae80713d-fd5a-47d8-ae1d-6619a9710dc5" containerID="f4cb2a2ae123f709ee1bb4f8a24062f3f00f9fa06c359a6b9adb5667406656ad" exitCode=0 Jun 11 15:18:10.619288 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:10.618756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r94bg" event={"ID":"ae80713d-fd5a-47d8-ae1d-6619a9710dc5","Type":"ContainerDied","Data":"f4cb2a2ae123f709ee1bb4f8a24062f3f00f9fa06c359a6b9adb5667406656ad"} Jun 11 15:18:10.672919 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:10.672877 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vdf75" podStartSLOduration=2.061887325 podStartE2EDuration="5.672859602s" totalImagesPullingTime="3.610972277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:10.672646749 +0000 UTC m=+39.688798030" watchObservedRunningTime="2026-06-11 15:18:10.672859602 +0000 UTC m=+39.689010878" Jun 11 15:18:11.623753 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:11.623717 2574 generic.go:356] "Generic (PLEG): container finished" podID="ae80713d-fd5a-47d8-ae1d-6619a9710dc5" containerID="1e5a5d7c30392281765fec4c2330dba563c57f86f5577b1785ca78de84168341" exitCode=0 Jun 11 15:18:11.624309 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:11.623792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r94bg" event={"ID":"ae80713d-fd5a-47d8-ae1d-6619a9710dc5","Type":"ContainerDied","Data":"1e5a5d7c30392281765fec4c2330dba563c57f86f5577b1785ca78de84168341"} Jun 11 15:18:12.632790 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:12.632749 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r94bg" event={"ID":"ae80713d-fd5a-47d8-ae1d-6619a9710dc5","Type":"ContainerStarted","Data":"1fe1f70982866ec7a43ee6602fadc657bdd5df310d51788d04d9386218bf130f"} Jun 11 15:18:12.677548 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:12.677485 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r94bg" podStartSLOduration=9.986677783 podStartE2EDuration="41.677470486s" totalImagesPullingTime="31.690792703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:12.677461702 +0000 UTC m=+41.693612994" watchObservedRunningTime="2026-06-11 15:18:12.677470486 +0000 UTC m=+41.693621761" Jun 11 15:18:13.101512 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:13.101466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:13.101512 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:13.101516 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:13.101714 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:13.101612 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:18:13.101714 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:13.101631 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:18:13.101714 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:13.101651 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:13.101714 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:13.101686 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:18:21.101671098 +0000 UTC m=+50.117822351 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:18:13.101714 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:13.101700 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:21.101694744 +0000 UTC m=+50.117845997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:18:21.157425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:21.157390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:21.157425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:21.157428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:21.158009 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:21.157532 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:21.158009 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:21.157561 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:18:21.158009 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:21.157581 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:18:21.158009 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:21.157596 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:18:37.157580296 +0000 UTC m=+66.173731561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:18:21.158009 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:21.157635 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:18:37.15762151 +0000 UTC m=+66.173772762 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:18:30.604049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:30.604020 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hzfnj" Jun 11 15:18:37.166525 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.166472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:18:37.166525 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.166519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:18:37.167074 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:37.166611 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:18:37.167074 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:37.166643 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:18:37.167074 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:37.166668 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:18:37.167074 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:37.166703 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:19:09.166689969 +0000 UTC m=+98.182841221 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:18:37.167074 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:37.166741 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:19:09.166722306 +0000 UTC m=+98.182873573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:18:37.267637 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.267607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:18:37.267828 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.267649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:18:37.267828 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.267672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:18:37.272294 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.272277 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 15:18:37.272632 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.272619 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 15:18:37.273088 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.273076 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 15:18:37.278328 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:37.278308 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:18:37.278385 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:18:37.278374 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:19:41.278355252 +0000 UTC m=+130.294506509 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : secret "metrics-daemon-secret" not found Jun 11 15:18:37.281536 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.281510 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43b712bb-ebe7-41d5-96f7-6fe84649c4fc-original-pull-secret\") pod \"global-pull-secret-syncer-r8rd8\" (UID: \"43b712bb-ebe7-41d5-96f7-6fe84649c4fc\") " pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:18:37.283567 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.283553 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 15:18:37.290641 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.290623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqtl\" (UniqueName: \"kubernetes.io/projected/060a912f-033d-4056-bcfc-8c145ccf6645-kube-api-access-vvqtl\") pod \"network-check-target-xq5jl\" (UID: \"060a912f-033d-4056-bcfc-8c145ccf6645\") " pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:18:37.544288 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.544237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r8rd8" Jun 11 15:18:37.561450 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.561426 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-92qml\"" Jun 11 15:18:37.567344 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.567323 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:18:37.698405 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.698373 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r8rd8"] Jun 11 15:18:37.702420 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:18:37.702397 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b712bb_ebe7_41d5_96f7_6fe84649c4fc.slice/crio-7982b809e81d3315c2ba915ced3e3709edd888834c8320d117ea68d45e53ab2a WatchSource:0}: Error finding container 7982b809e81d3315c2ba915ced3e3709edd888834c8320d117ea68d45e53ab2a: Status 404 returned error can't find the container with id 7982b809e81d3315c2ba915ced3e3709edd888834c8320d117ea68d45e53ab2a Jun 11 15:18:37.723347 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:37.723323 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xq5jl"] Jun 11 15:18:37.726407 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:18:37.726384 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod060a912f_033d_4056_bcfc_8c145ccf6645.slice/crio-512427af28d68177723faad5e779924656af776003be45f2f7e33711ca0316ba WatchSource:0}: Error finding container 512427af28d68177723faad5e779924656af776003be45f2f7e33711ca0316ba: Status 404 returned error can't find the container with id 512427af28d68177723faad5e779924656af776003be45f2f7e33711ca0316ba Jun 11 15:18:38.695075 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:38.695024 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r8rd8" event={"ID":"43b712bb-ebe7-41d5-96f7-6fe84649c4fc","Type":"ContainerStarted","Data":"7982b809e81d3315c2ba915ced3e3709edd888834c8320d117ea68d45e53ab2a"} Jun 11 15:18:38.696633 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:38.696598 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xq5jl" event={"ID":"060a912f-033d-4056-bcfc-8c145ccf6645","Type":"ContainerStarted","Data":"512427af28d68177723faad5e779924656af776003be45f2f7e33711ca0316ba"} Jun 11 15:18:42.709068 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:42.709028 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xq5jl" event={"ID":"060a912f-033d-4056-bcfc-8c145ccf6645","Type":"ContainerStarted","Data":"73fc86ae72a9c3245949bda120544c8bc09533a3ffe51d7a343fce5a1166be3e"} Jun 11 15:18:42.709507 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:42.709119 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:18:42.710380 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:42.710358 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r8rd8" event={"ID":"43b712bb-ebe7-41d5-96f7-6fe84649c4fc","Type":"ContainerStarted","Data":"13c6b56ed11b77b9a644c0ae3d57c99359a01a133c25584fb712f3a93de938c4"} Jun 11 15:18:42.728119 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:42.728075 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xq5jl" podStartSLOduration=67.502024787 podStartE2EDuration="1m11.728061506s" totalImagesPullingTime="4.226036719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:42.727012788 +0000 UTC m=+71.743164063" watchObservedRunningTime="2026-06-11 15:18:42.728061506 +0000 UTC m=+71.744212770" Jun 11 15:18:42.744412 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:18:42.744366 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r8rd8" podStartSLOduration=67.490816101 podStartE2EDuration="1m11.744353291s" totalImagesPullingTime="4.25353719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:18:42.743563402 +0000 UTC m=+71.759714675" watchObservedRunningTime="2026-06-11 15:18:42.744353291 +0000 UTC m=+71.760504564" Jun 11 15:19:09.201208 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:19:09.201174 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:19:09.201636 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:19:09.201213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:19:09.201636 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:19:09.201310 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:19:09.201636 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:19:09.201314 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:19:09.201636 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:19:09.201335 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:19:09.201636 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:19:09.201379 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:20:13.201362872 +0000 UTC m=+162.217514128 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:19:09.201636 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:19:09.201392 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:20:13.201386578 +0000 UTC m=+162.217537831 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:19:13.715652 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:19:13.715622 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xq5jl" Jun 11 15:19:41.318954 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:19:41.318905 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:19:41.319436 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:19:41.319047 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:19:41.319436 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:19:41.319121 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:21:43.319104994 +0000 UTC m=+252.335256246 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : secret "metrics-daemon-secret" not found Jun 11 15:20:08.352433 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:20:08.352374 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57f95779c-xjscb" podUID="190db870-eaf1-40e2-8511-5e2a34a4b36b" Jun 11 15:20:08.366534 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:20:08.366495 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qq7h7" podUID="8221e5a8-dc66-4499-a9d7-ac824f4ce656" Jun 11 15:20:08.452020 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:20:08.451969 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:20:08.913997 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:20:08.913966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:20:08.914167 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:20:08.913966 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qq7h7" Jun 11 15:20:13.230614 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:20:13.230553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:20:13.230614 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:20:13.230612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:20:13.231095 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:20:13.230700 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 15:20:13.231095 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:20:13.230721 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-57f95779c-xjscb: secret "image-registry-tls" not found Jun 11 15:20:13.231095 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:20:13.230721 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 15:20:13.231095 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:20:13.230817 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls podName:190db870-eaf1-40e2-8511-5e2a34a4b36b nodeName:}" failed. No retries permitted until 2026-06-11 15:22:15.230799738 +0000 UTC m=+284.246950992 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls") pod "image-registry-57f95779c-xjscb" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b") : secret "image-registry-tls" not found Jun 11 15:20:13.231095 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:20:13.230850 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls podName:8221e5a8-dc66-4499-a9d7-ac824f4ce656 nodeName:}" failed. No retries permitted until 2026-06-11 15:22:15.230837602 +0000 UTC m=+284.246988856 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls") pod "dns-default-qq7h7" (UID: "8221e5a8-dc66-4499-a9d7-ac824f4ce656") : secret "dns-default-metrics-tls" not found Jun 11 15:20:22.433548 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:20:22.433450 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:21:31.031513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.031480 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc"] Jun 11 15:21:31.033194 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.033179 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.036076 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.036048 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-682l7"] Jun 11 15:21:31.037351 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.037326 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-fxgvn\"" Jun 11 15:21:31.037817 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.037795 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd"] Jun 11 15:21:31.037920 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.037855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-682l7" Jun 11 15:21:31.038103 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.038085 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 15:21:31.038192 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.038085 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:21:31.038625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.038607 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 15:21:31.038918 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.038906 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 15:21:31.039541 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.039523 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-7scpf"] Jun 11 15:21:31.039608 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.039584 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:31.041244 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.041228 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.044935 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.044914 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ncj8n\"" Jun 11 15:21:31.045042 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.045014 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 11 15:21:31.045042 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.045034 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 11 15:21:31.045390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.045261 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:21:31.045390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.045273 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 15:21:31.045390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.045292 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:21:31.045390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.045316 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w4jkj\"" Jun 11 15:21:31.045390 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.045388 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 15:21:31.045666 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.045650 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-z859h\"" Jun 11 15:21:31.048839 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.048815 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 15:21:31.049467 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.049407 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc"] Jun 11 15:21:31.051197 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.051174 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-682l7"] Jun 11 15:21:31.052172 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.052148 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd"] Jun 11 15:21:31.059192 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.059166 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 15:21:31.064582 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.064562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-7scpf"] Jun 11 15:21:31.121000 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.120968 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx"] Jun 11 15:21:31.122882 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.122863 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:31.125145 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.125125 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 15:21:31.125247 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.125173 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w8rpq\"" Jun 11 15:21:31.125247 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.125199 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 15:21:31.128657 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.128630 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-p7qgn"] Jun 11 15:21:31.130340 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.130322 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6d85cd65c-l7d8c"] Jun 11 15:21:31.130469 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.130452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.131972 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.131956 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.132807 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.132790 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 15:21:31.132899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.132824 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 15:21:31.132899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.132835 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 15:21:31.132899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.132874 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 15:21:31.133089 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.133076 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xsrjj\"" Jun 11 15:21:31.138964 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.138948 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 15:21:31.139930 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.139912 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 15:21:31.141332 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.141315 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 15:21:31.141962 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.141936 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 15:21:31.142463 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.142438 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zb8gk\"" Jun 11 15:21:31.142705 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.142687 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 15:21:31.143821 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.143708 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 15:21:31.143903 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.143880 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx"] Jun 11 15:21:31.144906 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.144888 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 15:21:31.147230 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.147196 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-p7qgn"] Jun 11 15:21:31.148073 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.148053 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d85cd65c-l7d8c"] Jun 11 15:21:31.162114 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd9t7\" (UniqueName: \"kubernetes.io/projected/c84c4908-c457-4fdb-a5dc-6daf89c2a503-kube-api-access-rd9t7\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.162251 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97k7g\" (UniqueName: \"kubernetes.io/projected/f05089f8-0c8e-40f1-88bc-4081578a4e8b-kube-api-access-97k7g\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.162251 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f05089f8-0c8e-40f1-88bc-4081578a4e8b-trusted-ca\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.162251 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f05089f8-0c8e-40f1-88bc-4081578a4e8b-config\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.162251 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162227 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c84c4908-c457-4fdb-a5dc-6daf89c2a503-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.162251 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f05089f8-0c8e-40f1-88bc-4081578a4e8b-serving-cert\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.162408 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162296 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c84c4908-c457-4fdb-a5dc-6daf89c2a503-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.162408 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kbfr\" (UniqueName: \"kubernetes.io/projected/f672f25f-5334-4d76-bef9-4e5b7c827fdb-kube-api-access-6kbfr\") pod \"network-check-source-dbd9cf844-682l7\" (UID: \"f672f25f-5334-4d76-bef9-4e5b7c827fdb\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-682l7" Jun 11 15:21:31.162408 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:31.162408 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.162385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk4fd\" (UniqueName: \"kubernetes.io/projected/93df942b-df4f-4a75-b10c-b0368ce1c026-kube-api-access-zk4fd\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:31.263236 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-stats-auth\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.263236 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5996d218-4517-4fa2-bcbe-382499f0e7bf-tmp\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.263461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:31.263461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5996d218-4517-4fa2-bcbe-382499f0e7bf-service-ca-bundle\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.263461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cn6b\" (UniqueName: \"kubernetes.io/projected/ef735c11-5522-481c-a960-49e0fbee63da-kube-api-access-4cn6b\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.263461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263350 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.263461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263370 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kbfr\" (UniqueName: \"kubernetes.io/projected/f672f25f-5334-4d76-bef9-4e5b7c827fdb-kube-api-access-6kbfr\") pod \"network-check-source-dbd9cf844-682l7\" (UID: \"f672f25f-5334-4d76-bef9-4e5b7c827fdb\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-682l7" Jun 11 15:21:31.263461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263393 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5996d218-4517-4fa2-bcbe-382499f0e7bf-serving-cert\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.263461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjv7f\" (UniqueName: \"kubernetes.io/projected/5996d218-4517-4fa2-bcbe-382499f0e7bf-kube-api-access-zjv7f\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.263461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd9t7\" (UniqueName: \"kubernetes.io/projected/c84c4908-c457-4fdb-a5dc-6daf89c2a503-kube-api-access-rd9t7\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.263737 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263524 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.263737 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263564 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f05089f8-0c8e-40f1-88bc-4081578a4e8b-trusted-ca\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.263737 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f05089f8-0c8e-40f1-88bc-4081578a4e8b-config\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.263737 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c84c4908-c457-4fdb-a5dc-6daf89c2a503-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.263737 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263673 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f05089f8-0c8e-40f1-88bc-4081578a4e8b-serving-cert\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.263737 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c84c4908-c457-4fdb-a5dc-6daf89c2a503-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.263737 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5996d218-4517-4fa2-bcbe-382499f0e7bf-trusted-ca-bundle\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.264105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-default-certificate\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.264105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263839 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:31.264105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263883 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk4fd\" (UniqueName: \"kubernetes.io/projected/93df942b-df4f-4a75-b10c-b0368ce1c026-kube-api-access-zk4fd\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:31.264105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb4152bf-a915-4c08-a81a-0d50c1da531c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:31.264105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97k7g\" (UniqueName: \"kubernetes.io/projected/f05089f8-0c8e-40f1-88bc-4081578a4e8b-kube-api-access-97k7g\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.264105 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.263971 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:21:31.264105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.263975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5996d218-4517-4fa2-bcbe-382499f0e7bf-snapshots\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.264105 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.264061 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls podName:93df942b-df4f-4a75-b10c-b0368ce1c026 nodeName:}" failed. No retries permitted until 2026-06-11 15:21:31.764039567 +0000 UTC m=+240.780190834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-d9vrd" (UID: "93df942b-df4f-4a75-b10c-b0368ce1c026") : secret "samples-operator-tls" not found Jun 11 15:21:31.264498 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.264305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c84c4908-c457-4fdb-a5dc-6daf89c2a503-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.264498 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.264367 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f05089f8-0c8e-40f1-88bc-4081578a4e8b-config\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.264903 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.264884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f05089f8-0c8e-40f1-88bc-4081578a4e8b-trusted-ca\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.266109 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.266087 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c84c4908-c457-4fdb-a5dc-6daf89c2a503-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.266202 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.266175 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f05089f8-0c8e-40f1-88bc-4081578a4e8b-serving-cert\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.274021 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.273996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd9t7\" (UniqueName: \"kubernetes.io/projected/c84c4908-c457-4fdb-a5dc-6daf89c2a503-kube-api-access-rd9t7\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-scmcc\" (UID: \"c84c4908-c457-4fdb-a5dc-6daf89c2a503\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.277697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.277674 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk4fd\" (UniqueName: \"kubernetes.io/projected/93df942b-df4f-4a75-b10c-b0368ce1c026-kube-api-access-zk4fd\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:31.277818 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.277802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97k7g\" (UniqueName: \"kubernetes.io/projected/f05089f8-0c8e-40f1-88bc-4081578a4e8b-kube-api-access-97k7g\") pod \"console-operator-668fdbf85c-7scpf\" (UID: \"f05089f8-0c8e-40f1-88bc-4081578a4e8b\") " pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.278124 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.278108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kbfr\" (UniqueName: \"kubernetes.io/projected/f672f25f-5334-4d76-bef9-4e5b7c827fdb-kube-api-access-6kbfr\") pod \"network-check-source-dbd9cf844-682l7\" (UID: \"f672f25f-5334-4d76-bef9-4e5b7c827fdb\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-682l7" Jun 11 15:21:31.344003 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.343923 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" Jun 11 15:21:31.353529 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.353499 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ncj8n\"" Jun 11 15:21:31.361634 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.361604 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-682l7" Jun 11 15:21:31.364630 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.364605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb4152bf-a915-4c08-a81a-0d50c1da531c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:31.364729 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.364637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5996d218-4517-4fa2-bcbe-382499f0e7bf-snapshots\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.364729 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.364672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-stats-auth\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.364729 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.364700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5996d218-4517-4fa2-bcbe-382499f0e7bf-tmp\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.364729 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.364722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:31.364957 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.364748 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5996d218-4517-4fa2-bcbe-382499f0e7bf-service-ca-bundle\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.364957 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.364784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cn6b\" (UniqueName: \"kubernetes.io/projected/ef735c11-5522-481c-a960-49e0fbee63da-kube-api-access-4cn6b\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.365261 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.365227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.365261 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.365255 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5996d218-4517-4fa2-bcbe-382499f0e7bf-tmp\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.365613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.365291 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5996d218-4517-4fa2-bcbe-382499f0e7bf-serving-cert\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.365613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.365314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5996d218-4517-4fa2-bcbe-382499f0e7bf-snapshots\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.365613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.365325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjv7f\" (UniqueName: \"kubernetes.io/projected/5996d218-4517-4fa2-bcbe-382499f0e7bf-kube-api-access-zjv7f\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.365613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.365400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.365613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.365482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5996d218-4517-4fa2-bcbe-382499f0e7bf-trusted-ca-bundle\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.365613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.365512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-default-certificate\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.367247 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367227 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 11 15:21:31.367352 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367262 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 15:21:31.367352 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367324 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 15:21:31.367582 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367563 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 11 15:21:31.367699 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367592 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-z859h\"" Jun 11 15:21:31.367699 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367563 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 15:21:31.367699 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367611 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 15:21:31.367699 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367679 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 15:21:31.367957 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.367942 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 15:21:31.372738 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.372719 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 15:21:31.373480 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.373464 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 15:21:31.373710 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.373693 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 15:21:31.375282 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.375264 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 15:21:31.375370 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.375329 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:21:31.375467 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.375332 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert podName:bb4152bf-a915-4c08-a81a-0d50c1da531c nodeName:}" failed. No retries permitted until 2026-06-11 15:21:31.875311932 +0000 UTC m=+240.891463187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qhvqx" (UID: "bb4152bf-a915-4c08-a81a-0d50c1da531c") : secret "networking-console-plugin-cert" not found Jun 11 15:21:31.375467 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.375411 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:31.375594 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.375411 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:31.875393046 +0000 UTC m=+240.891544304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : secret "router-metrics-certs-default" not found Jun 11 15:21:31.375727 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.375705 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb4152bf-a915-4c08-a81a-0d50c1da531c-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:31.375882 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.375763 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5996d218-4517-4fa2-bcbe-382499f0e7bf-service-ca-bundle\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.375989 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.375888 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:31.875870997 +0000 UTC m=+240.892022266 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : configmap references non-existent config key: service-ca.crt Jun 11 15:21:31.376519 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.376493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5996d218-4517-4fa2-bcbe-382499f0e7bf-trusted-ca-bundle\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.377926 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.377812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5996d218-4517-4fa2-bcbe-382499f0e7bf-serving-cert\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.378362 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.378343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-stats-auth\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.378688 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.378673 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-default-certificate\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.385353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.385114 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 15:21:31.385465 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.385379 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 15:21:31.395186 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.395155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjv7f\" (UniqueName: \"kubernetes.io/projected/5996d218-4517-4fa2-bcbe-382499f0e7bf-kube-api-access-zjv7f\") pod \"insights-operator-896549976-p7qgn\" (UID: \"5996d218-4517-4fa2-bcbe-382499f0e7bf\") " pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.396046 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.396022 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cn6b\" (UniqueName: \"kubernetes.io/projected/ef735c11-5522-481c-a960-49e0fbee63da-kube-api-access-4cn6b\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.444062 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.443737 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xsrjj\"" Jun 11 15:21:31.452539 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.451270 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-p7qgn" Jun 11 15:21:31.504819 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.504732 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc"] Jun 11 15:21:31.506936 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:21:31.506907 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc84c4908_c457_4fdb_a5dc_6daf89c2a503.slice/crio-f87f962368a335f76ff563b98a0e7dffd2a70487b1a5d827d2d156ad843114cc WatchSource:0}: Error finding container f87f962368a335f76ff563b98a0e7dffd2a70487b1a5d827d2d156ad843114cc: Status 404 returned error can't find the container with id f87f962368a335f76ff563b98a0e7dffd2a70487b1a5d827d2d156ad843114cc Jun 11 15:21:31.524143 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.524090 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-682l7"] Jun 11 15:21:31.526982 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:21:31.526955 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf672f25f_5334_4d76_bef9_4e5b7c827fdb.slice/crio-cd0cb9eb353e49158eb5e25930fd0f901b2a2b5debda175577bab180a28d5392 WatchSource:0}: Error finding container cd0cb9eb353e49158eb5e25930fd0f901b2a2b5debda175577bab180a28d5392: Status 404 returned error can't find the container with id cd0cb9eb353e49158eb5e25930fd0f901b2a2b5debda175577bab180a28d5392 Jun 11 15:21:31.543125 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.543100 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-7scpf"] Jun 11 15:21:31.553017 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:21:31.552977 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf05089f8_0c8e_40f1_88bc_4081578a4e8b.slice/crio-3775908b33f678ae1dde26aa70ec338feb68ac05b3e8296e794e2662d55347dc WatchSource:0}: Error finding container 3775908b33f678ae1dde26aa70ec338feb68ac05b3e8296e794e2662d55347dc: Status 404 returned error can't find the container with id 3775908b33f678ae1dde26aa70ec338feb68ac05b3e8296e794e2662d55347dc Jun 11 15:21:31.598621 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.598538 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-p7qgn"] Jun 11 15:21:31.601579 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:21:31.601546 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5996d218_4517_4fa2_bcbe_382499f0e7bf.slice/crio-cf4032497e408e5241e013f87e7909fca2d7dbc69a356a7947012c11162e0060 WatchSource:0}: Error finding container cf4032497e408e5241e013f87e7909fca2d7dbc69a356a7947012c11162e0060: Status 404 returned error can't find the container with id cf4032497e408e5241e013f87e7909fca2d7dbc69a356a7947012c11162e0060 Jun 11 15:21:31.769854 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.769754 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:31.770047 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.769920 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:21:31.770047 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.769990 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls podName:93df942b-df4f-4a75-b10c-b0368ce1c026 nodeName:}" failed. No retries permitted until 2026-06-11 15:21:32.7699708 +0000 UTC m=+241.786122074 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-d9vrd" (UID: "93df942b-df4f-4a75-b10c-b0368ce1c026") : secret "samples-operator-tls" not found Jun 11 15:21:31.972278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.972246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.972462 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.972347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:31.972462 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.972427 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 15:21:31.972462 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.972433 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:32.972410767 +0000 UTC m=+241.988562040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : configmap references non-existent config key: service-ca.crt Jun 11 15:21:31.972462 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:31.972460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:31.972672 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.972465 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert podName:bb4152bf-a915-4c08-a81a-0d50c1da531c nodeName:}" failed. No retries permitted until 2026-06-11 15:21:32.97245451 +0000 UTC m=+241.988605766 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qhvqx" (UID: "bb4152bf-a915-4c08-a81a-0d50c1da531c") : secret "networking-console-plugin-cert" not found Jun 11 15:21:31.972672 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.972589 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:21:31.972672 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:31.972652 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:32.972635208 +0000 UTC m=+241.988786478 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : secret "router-metrics-certs-default" not found Jun 11 15:21:32.108942 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.108901 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" event={"ID":"c84c4908-c457-4fdb-a5dc-6daf89c2a503","Type":"ContainerStarted","Data":"f87f962368a335f76ff563b98a0e7dffd2a70487b1a5d827d2d156ad843114cc"} Jun 11 15:21:32.110450 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.110419 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" event={"ID":"f05089f8-0c8e-40f1-88bc-4081578a4e8b","Type":"ContainerStarted","Data":"3775908b33f678ae1dde26aa70ec338feb68ac05b3e8296e794e2662d55347dc"} Jun 11 15:21:32.112332 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.112304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-682l7" event={"ID":"f672f25f-5334-4d76-bef9-4e5b7c827fdb","Type":"ContainerStarted","Data":"50c110c6b3e4a6049344f7afda82fa23ae42a01cc88239a4c552be66e0817873"} Jun 11 15:21:32.112441 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.112355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-682l7" event={"ID":"f672f25f-5334-4d76-bef9-4e5b7c827fdb","Type":"ContainerStarted","Data":"cd0cb9eb353e49158eb5e25930fd0f901b2a2b5debda175577bab180a28d5392"} Jun 11 15:21:32.113561 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.113517 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-p7qgn" event={"ID":"5996d218-4517-4fa2-bcbe-382499f0e7bf","Type":"ContainerStarted","Data":"cf4032497e408e5241e013f87e7909fca2d7dbc69a356a7947012c11162e0060"} Jun 11 15:21:32.129495 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.129437 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-682l7" podStartSLOduration=1.129416139 podStartE2EDuration="1.129416139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:32.128698523 +0000 UTC m=+241.144849800" watchObservedRunningTime="2026-06-11 15:21:32.129416139 +0000 UTC m=+241.145567416" Jun 11 15:21:32.781458 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.781422 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:32.781654 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:32.781600 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:21:32.781728 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:32.781717 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls podName:93df942b-df4f-4a75-b10c-b0368ce1c026 nodeName:}" failed. No retries permitted until 2026-06-11 15:21:34.78169453 +0000 UTC m=+243.797845802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-d9vrd" (UID: "93df942b-df4f-4a75-b10c-b0368ce1c026") : secret "samples-operator-tls" not found Jun 11 15:21:32.983591 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.983545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:32.983820 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.983602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:32.983820 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:32.983650 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:32.983820 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:32.983690 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 15:21:32.983820 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:32.983752 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert podName:bb4152bf-a915-4c08-a81a-0d50c1da531c nodeName:}" failed. No retries permitted until 2026-06-11 15:21:34.983733643 +0000 UTC m=+243.999884900 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qhvqx" (UID: "bb4152bf-a915-4c08-a81a-0d50c1da531c") : secret "networking-console-plugin-cert" not found Jun 11 15:21:32.984046 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:32.983825 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:34.983813627 +0000 UTC m=+243.999964880 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : configmap references non-existent config key: service-ca.crt Jun 11 15:21:32.984046 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:32.983895 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:21:32.984046 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:32.983927 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:34.983917928 +0000 UTC m=+244.000069181 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : secret "router-metrics-certs-default" not found Jun 11 15:21:34.802607 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:34.802507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:34.802985 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:34.802696 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:21:34.802985 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:34.802793 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls podName:93df942b-df4f-4a75-b10c-b0368ce1c026 nodeName:}" failed. No retries permitted until 2026-06-11 15:21:38.802758951 +0000 UTC m=+247.818910210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-d9vrd" (UID: "93df942b-df4f-4a75-b10c-b0368ce1c026") : secret "samples-operator-tls" not found Jun 11 15:21:35.005036 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.004981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:35.005036 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.005035 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:35.005292 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.005081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:35.005292 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:35.005158 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 15:21:35.005292 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:35.005227 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:21:35.005292 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:35.005240 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert podName:bb4152bf-a915-4c08-a81a-0d50c1da531c nodeName:}" failed. No retries permitted until 2026-06-11 15:21:39.005219376 +0000 UTC m=+248.021370635 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qhvqx" (UID: "bb4152bf-a915-4c08-a81a-0d50c1da531c") : secret "networking-console-plugin-cert" not found Jun 11 15:21:35.005292 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:35.005293 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:39.00527709 +0000 UTC m=+248.021428350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : configmap references non-existent config key: service-ca.crt Jun 11 15:21:35.005496 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:35.005316 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:39.0053067 +0000 UTC m=+248.021457959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : secret "router-metrics-certs-default" not found Jun 11 15:21:35.129541 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.129443 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-p7qgn" event={"ID":"5996d218-4517-4fa2-bcbe-382499f0e7bf","Type":"ContainerStarted","Data":"85d4757dcf1366a1bc9a2b97b9e980f5af8784a3414fa8a3b798b26ebd0288e9"} Jun 11 15:21:35.130911 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.130881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" event={"ID":"c84c4908-c457-4fdb-a5dc-6daf89c2a503","Type":"ContainerStarted","Data":"d6daa7b4031ef5016cfb06f68c622d5f7b333ad57cd1eac263bdbd3c64cae07e"} Jun 11 15:21:35.132340 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.132319 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/0.log" Jun 11 15:21:35.132426 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.132351 2574 generic.go:356] "Generic (PLEG): container finished" podID="f05089f8-0c8e-40f1-88bc-4081578a4e8b" containerID="05eca0a79be08b7ca082744a44e202c3b18dfde74462542b13d58a70003afcfd" exitCode=255 Jun 11 15:21:35.132426 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.132386 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" event={"ID":"f05089f8-0c8e-40f1-88bc-4081578a4e8b","Type":"ContainerDied","Data":"05eca0a79be08b7ca082744a44e202c3b18dfde74462542b13d58a70003afcfd"} Jun 11 15:21:35.132568 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.132557 2574 scope.go:117] "RemoveContainer" containerID="05eca0a79be08b7ca082744a44e202c3b18dfde74462542b13d58a70003afcfd" Jun 11 15:21:35.148099 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.148047 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-p7qgn" podStartSLOduration=1.198560056 podStartE2EDuration="4.14802978s" totalImagesPullingTime="2.949469724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:35.146608797 +0000 UTC m=+244.162760073" watchObservedRunningTime="2026-06-11 15:21:35.14802978 +0000 UTC m=+244.164181056" Jun 11 15:21:35.163666 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:35.163613 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" podStartSLOduration=1.116085057 podStartE2EDuration="4.163595089s" totalImagesPullingTime="3.047510032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:35.163022432 +0000 UTC m=+244.179173706" watchObservedRunningTime="2026-06-11 15:21:35.163595089 +0000 UTC m=+244.179746404" Jun 11 15:21:36.137790 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:36.137748 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:21:36.138233 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:36.138193 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/0.log" Jun 11 15:21:36.138290 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:36.138232 2574 generic.go:356] "Generic (PLEG): container finished" podID="f05089f8-0c8e-40f1-88bc-4081578a4e8b" containerID="0dcbc09e62d0dbbad46cfbce4df69d3db97e0a4cd85c4d19e84e70091de6624e" exitCode=255 Jun 11 15:21:36.138353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:36.138318 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" event={"ID":"f05089f8-0c8e-40f1-88bc-4081578a4e8b","Type":"ContainerDied","Data":"0dcbc09e62d0dbbad46cfbce4df69d3db97e0a4cd85c4d19e84e70091de6624e"} Jun 11 15:21:36.138404 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:36.138368 2574 scope.go:117] "RemoveContainer" containerID="05eca0a79be08b7ca082744a44e202c3b18dfde74462542b13d58a70003afcfd" Jun 11 15:21:36.138514 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:36.138491 2574 scope.go:117] "RemoveContainer" containerID="0dcbc09e62d0dbbad46cfbce4df69d3db97e0a4cd85c4d19e84e70091de6624e" Jun 11 15:21:36.138708 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:36.138686 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-7scpf_openshift-console-operator(f05089f8-0c8e-40f1-88bc-4081578a4e8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" podUID="f05089f8-0c8e-40f1-88bc-4081578a4e8b" Jun 11 15:21:37.142880 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.142857 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:21:37.143241 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.143176 2574 scope.go:117] "RemoveContainer" containerID="0dcbc09e62d0dbbad46cfbce4df69d3db97e0a4cd85c4d19e84e70091de6624e" Jun 11 15:21:37.143349 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:37.143330 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-7scpf_openshift-console-operator(f05089f8-0c8e-40f1-88bc-4081578a4e8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" podUID="f05089f8-0c8e-40f1-88bc-4081578a4e8b" Jun 11 15:21:37.670004 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.669979 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tk8cn_170b29a8-6051-453e-946c-6868a305f89a/dns-node-resolver/0.log" Jun 11 15:21:37.721335 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.721301 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6"] Jun 11 15:21:37.726023 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.725994 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" Jun 11 15:21:37.728214 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.728189 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-spkph\"" Jun 11 15:21:37.728214 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.728194 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 15:21:37.728922 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.728907 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 15:21:37.732668 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.732643 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6"] Jun 11 15:21:37.832207 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.832175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9fr4\" (UniqueName: \"kubernetes.io/projected/9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2-kube-api-access-h9fr4\") pod \"migrator-955ffdf5f-vlkp6\" (UID: \"9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" Jun 11 15:21:37.932944 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.932918 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9fr4\" (UniqueName: \"kubernetes.io/projected/9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2-kube-api-access-h9fr4\") pod \"migrator-955ffdf5f-vlkp6\" (UID: \"9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" Jun 11 15:21:37.942279 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:37.942250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9fr4\" (UniqueName: \"kubernetes.io/projected/9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2-kube-api-access-h9fr4\") pod \"migrator-955ffdf5f-vlkp6\" (UID: \"9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" Jun 11 15:21:38.034822 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:38.034763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" Jun 11 15:21:38.166882 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:38.166848 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6"] Jun 11 15:21:38.169848 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:21:38.169824 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef2e6f3_04ee_4607_8c31_7e4ac964f2a2.slice/crio-0d6ddaca73dc21d8e1af6ad280dc9355c3821f3ab8f98df8478167934816fa45 WatchSource:0}: Error finding container 0d6ddaca73dc21d8e1af6ad280dc9355c3821f3ab8f98df8478167934816fa45: Status 404 returned error can't find the container with id 0d6ddaca73dc21d8e1af6ad280dc9355c3821f3ab8f98df8478167934816fa45 Jun 11 15:21:38.670944 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:38.670916 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nwhjd_905a9018-eb8e-41f3-9195-41afce5bc689/node-ca/0.log" Jun 11 15:21:38.841767 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:38.841726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:38.841967 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:38.841914 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 11 15:21:38.842050 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:38.841998 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls podName:93df942b-df4f-4a75-b10c-b0368ce1c026 nodeName:}" failed. No retries permitted until 2026-06-11 15:21:46.841976126 +0000 UTC m=+255.858127382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-d9vrd" (UID: "93df942b-df4f-4a75-b10c-b0368ce1c026") : secret "samples-operator-tls" not found Jun 11 15:21:39.044171 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:39.044131 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:39.044171 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:39.044173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:39.044453 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:39.044215 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:39.044453 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:39.044301 2574 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 11 15:21:39.044453 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:39.044347 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 15:21:39.044453 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:39.044379 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert podName:bb4152bf-a915-4c08-a81a-0d50c1da531c nodeName:}" failed. No retries permitted until 2026-06-11 15:21:47.044359369 +0000 UTC m=+256.060510628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-qhvqx" (UID: "bb4152bf-a915-4c08-a81a-0d50c1da531c") : secret "networking-console-plugin-cert" not found Jun 11 15:21:39.044453 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:39.044398 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:47.044389016 +0000 UTC m=+256.060540269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : configmap references non-existent config key: service-ca.crt Jun 11 15:21:39.044453 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:39.044413 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs podName:ef735c11-5522-481c-a960-49e0fbee63da nodeName:}" failed. No retries permitted until 2026-06-11 15:21:47.044404567 +0000 UTC m=+256.060555846 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs") pod "router-default-6d85cd65c-l7d8c" (UID: "ef735c11-5522-481c-a960-49e0fbee63da") : secret "router-metrics-certs-default" not found Jun 11 15:21:39.150667 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:39.150638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" event={"ID":"9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2","Type":"ContainerStarted","Data":"0d6ddaca73dc21d8e1af6ad280dc9355c3821f3ab8f98df8478167934816fa45"} Jun 11 15:21:39.672119 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:39.672093 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdf75_c763b42a-b789-418f-947e-24f064579283/serve-healthcheck-canary/0.log" Jun 11 15:21:40.155400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:40.155355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" event={"ID":"9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2","Type":"ContainerStarted","Data":"f7a773b199eebd7754256f03d64f304ca330a87390c196e0c9dab9024386f1f7"} Jun 11 15:21:40.155710 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:40.155413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" event={"ID":"9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2","Type":"ContainerStarted","Data":"75e9ef2e9c9238b14b81d6d078aeb641de8ea968f1bd738c2f0b14893b5c1546"} Jun 11 15:21:40.187304 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:40.187249 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-vlkp6" podStartSLOduration=2.217778968 podStartE2EDuration="3.187233051s" totalImagesPullingTime="969.454083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:40.18644686 +0000 UTC m=+249.202598135" watchObservedRunningTime="2026-06-11 15:21:40.187233051 +0000 UTC m=+249.203384327" Jun 11 15:21:41.375680 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:41.375648 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:41.376194 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:41.375712 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:41.376194 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:41.376135 2574 scope.go:117] "RemoveContainer" containerID="0dcbc09e62d0dbbad46cfbce4df69d3db97e0a4cd85c4d19e84e70091de6624e" Jun 11 15:21:41.376345 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:41.376322 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-7scpf_openshift-console-operator(f05089f8-0c8e-40f1-88bc-4081578a4e8b)\"" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" podUID="f05089f8-0c8e-40f1-88bc-4081578a4e8b" Jun 11 15:21:43.381629 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:43.381589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:21:43.382042 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:43.381753 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 15:21:43.382042 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:21:43.381842 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs podName:053352ba-ba2b-4fa2-ab5c-ef62c4012e35 nodeName:}" failed. No retries permitted until 2026-06-11 15:23:45.381827133 +0000 UTC m=+374.397978389 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs") pod "network-metrics-daemon-58xmz" (UID: "053352ba-ba2b-4fa2-ab5c-ef62c4012e35") : secret "metrics-daemon-secret" not found Jun 11 15:21:46.910680 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:46.910637 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:46.913123 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:46.913098 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/93df942b-df4f-4a75-b10c-b0368ce1c026-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-d9vrd\" (UID: \"93df942b-df4f-4a75-b10c-b0368ce1c026\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:46.962931 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:46.962900 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-w4jkj\"" Jun 11 15:21:46.971783 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:46.971753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" Jun 11 15:21:47.099471 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.099440 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd"] Jun 11 15:21:47.111765 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.111741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:47.111947 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.111816 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:47.111947 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.111860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:47.112427 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.112409 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef735c11-5522-481c-a960-49e0fbee63da-service-ca-bundle\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:47.114280 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.114259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef735c11-5522-481c-a960-49e0fbee63da-metrics-certs\") pod \"router-default-6d85cd65c-l7d8c\" (UID: \"ef735c11-5522-481c-a960-49e0fbee63da\") " pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:47.114419 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.114398 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bb4152bf-a915-4c08-a81a-0d50c1da531c-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-qhvqx\" (UID: \"bb4152bf-a915-4c08-a81a-0d50c1da531c\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:47.178125 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.178048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" event={"ID":"93df942b-df4f-4a75-b10c-b0368ce1c026","Type":"ContainerStarted","Data":"1887343e0d6b60070136d944e2ca9364b79bb5aa554fa0aed920fa6bcd1f04ad"} Jun 11 15:21:47.335318 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.335284 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-w8rpq\"" Jun 11 15:21:47.343551 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.343526 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" Jun 11 15:21:47.348318 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.348301 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zb8gk\"" Jun 11 15:21:47.357153 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.357130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:47.475352 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.475322 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx"] Jun 11 15:21:47.478184 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:21:47.478160 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4152bf_a915_4c08_a81a_0d50c1da531c.slice/crio-11a39ecd6e81ff141be722d63a801509f77f9f670216ca9f53fc47d6e8389a91 WatchSource:0}: Error finding container 11a39ecd6e81ff141be722d63a801509f77f9f670216ca9f53fc47d6e8389a91: Status 404 returned error can't find the container with id 11a39ecd6e81ff141be722d63a801509f77f9f670216ca9f53fc47d6e8389a91 Jun 11 15:21:47.494851 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:47.494825 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6d85cd65c-l7d8c"] Jun 11 15:21:47.498261 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:21:47.498237 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef735c11_5522_481c_a960_49e0fbee63da.slice/crio-7b5addd1a8d1328a84339514f538cc6ff322170e4a27fd151563968b38c51ad4 WatchSource:0}: Error finding container 7b5addd1a8d1328a84339514f538cc6ff322170e4a27fd151563968b38c51ad4: Status 404 returned error can't find the container with id 7b5addd1a8d1328a84339514f538cc6ff322170e4a27fd151563968b38c51ad4 Jun 11 15:21:48.184825 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:48.184764 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" event={"ID":"bb4152bf-a915-4c08-a81a-0d50c1da531c","Type":"ContainerStarted","Data":"11a39ecd6e81ff141be722d63a801509f77f9f670216ca9f53fc47d6e8389a91"} Jun 11 15:21:48.186826 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:48.186794 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" event={"ID":"ef735c11-5522-481c-a960-49e0fbee63da","Type":"ContainerStarted","Data":"b2c334e76bc20bd62f90b332a15cca8a430523092722490f67f9aacb1cd9d1ee"} Jun 11 15:21:48.186986 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:48.186843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" event={"ID":"ef735c11-5522-481c-a960-49e0fbee63da","Type":"ContainerStarted","Data":"7b5addd1a8d1328a84339514f538cc6ff322170e4a27fd151563968b38c51ad4"} Jun 11 15:21:48.208952 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:48.208909 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" podStartSLOduration=17.208894606 podStartE2EDuration="17.208894606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:48.207748996 +0000 UTC m=+257.223900271" watchObservedRunningTime="2026-06-11 15:21:48.208894606 +0000 UTC m=+257.225045881" Jun 11 15:21:48.358320 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:48.358285 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:48.361382 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:48.361353 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:49.189884 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:49.189805 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:49.191020 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:49.190998 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6d85cd65c-l7d8c" Jun 11 15:21:50.195866 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:50.195825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" event={"ID":"bb4152bf-a915-4c08-a81a-0d50c1da531c","Type":"ContainerStarted","Data":"c9dd225c1c68bcf5529581afe68d1114e5fd345deb598e9df22a83c5bf743328"} Jun 11 15:21:50.197737 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:50.197711 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" event={"ID":"93df942b-df4f-4a75-b10c-b0368ce1c026","Type":"ContainerStarted","Data":"ad52d28b899ecd2223df5a1b4b44caac86e56c70c6ae0e875ffb5aab89dba66a"} Jun 11 15:21:50.197877 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:50.197756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" event={"ID":"93df942b-df4f-4a75-b10c-b0368ce1c026","Type":"ContainerStarted","Data":"22be7b5683bb40f5922f65c8e7b4e7293545977c7c6bcbf0e5ff5325c3c13e9b"} Jun 11 15:21:50.213573 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:50.213531 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-qhvqx" podStartSLOduration=17.476096065 podStartE2EDuration="19.213516938s" totalImagesPullingTime="1.737420873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:50.213273548 +0000 UTC m=+259.229424825" watchObservedRunningTime="2026-06-11 15:21:50.213516938 +0000 UTC m=+259.229668212" Jun 11 15:21:50.233536 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:50.233493 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-d9vrd" podStartSLOduration=17.164916012 podStartE2EDuration="19.233479355s" totalImagesPullingTime="2.068563343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:50.232878928 +0000 UTC m=+259.249030205" watchObservedRunningTime="2026-06-11 15:21:50.233479355 +0000 UTC m=+259.249630630" Jun 11 15:21:54.434097 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:54.434068 2574 scope.go:117] "RemoveContainer" containerID="0dcbc09e62d0dbbad46cfbce4df69d3db97e0a4cd85c4d19e84e70091de6624e" Jun 11 15:21:55.220762 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:55.220733 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:21:55.220917 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:55.220818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" event={"ID":"f05089f8-0c8e-40f1-88bc-4081578a4e8b","Type":"ContainerStarted","Data":"6d228bbe135b8f227b2d77917f35119dbe54b5dc95d5b42c7cb853cf90ebf350"} Jun 11 15:21:55.221276 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:55.221250 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:55.225731 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:55.225707 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" Jun 11 15:21:55.241996 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:55.241952 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-7scpf" podStartSLOduration=21.238187558 podStartE2EDuration="24.241937903s" totalImagesPullingTime="3.003750345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:21:55.240965368 +0000 UTC m=+264.257116644" watchObservedRunningTime="2026-06-11 15:21:55.241937903 +0000 UTC m=+264.258089239" Jun 11 15:21:59.549555 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.549522 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-44h45"] Jun 11 15:21:59.552952 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.552928 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.555245 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.555219 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 15:21:59.556012 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.555988 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l288v\"" Jun 11 15:21:59.556132 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.556062 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 15:21:59.569678 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.569652 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44h45"] Jun 11 15:21:59.620162 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.620132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c997db-cf65-453e-a84f-94c71b34f4ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.620319 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.620169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbwr4\" (UniqueName: \"kubernetes.io/projected/b1c997db-cf65-453e-a84f-94c71b34f4ac-kube-api-access-wbwr4\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.620319 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.620192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c997db-cf65-453e-a84f-94c71b34f4ac-data-volume\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.620319 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.620284 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c997db-cf65-453e-a84f-94c71b34f4ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.620319 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.620314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1c997db-cf65-453e-a84f-94c71b34f4ac-crio-socket\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.720972 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.720937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c997db-cf65-453e-a84f-94c71b34f4ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.721140 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.720982 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1c997db-cf65-453e-a84f-94c71b34f4ac-crio-socket\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.721140 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.721026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c997db-cf65-453e-a84f-94c71b34f4ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.721140 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.721048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbwr4\" (UniqueName: \"kubernetes.io/projected/b1c997db-cf65-453e-a84f-94c71b34f4ac-kube-api-access-wbwr4\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.721140 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.721072 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c997db-cf65-453e-a84f-94c71b34f4ac-data-volume\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.721288 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.721159 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b1c997db-cf65-453e-a84f-94c71b34f4ac-crio-socket\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.721475 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.721458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1c997db-cf65-453e-a84f-94c71b34f4ac-data-volume\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.721749 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.721727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b1c997db-cf65-453e-a84f-94c71b34f4ac-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.723420 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.723399 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b1c997db-cf65-453e-a84f-94c71b34f4ac-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.731130 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.731106 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbwr4\" (UniqueName: \"kubernetes.io/projected/b1c997db-cf65-453e-a84f-94c71b34f4ac-kube-api-access-wbwr4\") pod \"insights-runtime-extractor-44h45\" (UID: \"b1c997db-cf65-453e-a84f-94c71b34f4ac\") " pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:21:59.863367 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:21:59.863273 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44h45" Jun 11 15:22:00.015891 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:00.015853 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44h45"] Jun 11 15:22:00.018588 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:22:00.018551 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c997db_cf65_453e_a84f_94c71b34f4ac.slice/crio-b9057e5084dc6eec36b7043fb86852eefd9c26ddb87587ee33976f03e3db6464 WatchSource:0}: Error finding container b9057e5084dc6eec36b7043fb86852eefd9c26ddb87587ee33976f03e3db6464: Status 404 returned error can't find the container with id b9057e5084dc6eec36b7043fb86852eefd9c26ddb87587ee33976f03e3db6464 Jun 11 15:22:00.239935 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:00.239899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44h45" event={"ID":"b1c997db-cf65-453e-a84f-94c71b34f4ac","Type":"ContainerStarted","Data":"b6b497bcb52f038dbeb4927cddb4b337d17188e103163ae70bfba1810dee2f1b"} Jun 11 15:22:00.240087 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:00.239956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44h45" event={"ID":"b1c997db-cf65-453e-a84f-94c71b34f4ac","Type":"ContainerStarted","Data":"b9057e5084dc6eec36b7043fb86852eefd9c26ddb87587ee33976f03e3db6464"} Jun 11 15:22:01.244926 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:01.244892 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44h45" event={"ID":"b1c997db-cf65-453e-a84f-94c71b34f4ac","Type":"ContainerStarted","Data":"0887507292cfc8f48518de239008448eebd0c8897f2d38e2037a39c5e0a2c5c3"} Jun 11 15:22:02.397358 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.397323 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9"] Jun 11 15:22:02.404346 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.404306 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.407191 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.407164 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 15:22:02.407342 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.407165 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 15:22:02.407342 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.407263 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 15:22:02.408050 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.407988 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rzvbs\"" Jun 11 15:22:02.408501 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.408321 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 15:22:02.408501 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.408348 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 15:22:02.409825 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.409761 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9"] Jun 11 15:22:02.447692 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.447647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.447899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.447732 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.447899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.447759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wvpb\" (UniqueName: \"kubernetes.io/projected/66b484ea-bec9-4827-98ab-a4d55ea83c6e-kube-api-access-2wvpb\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.447899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.447802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b484ea-bec9-4827-98ab-a4d55ea83c6e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.548194 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.548173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.548281 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.548204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wvpb\" (UniqueName: \"kubernetes.io/projected/66b484ea-bec9-4827-98ab-a4d55ea83c6e-kube-api-access-2wvpb\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.548281 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.548223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b484ea-bec9-4827-98ab-a4d55ea83c6e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.548428 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.548410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.548550 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:22:02.548534 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 15:22:02.548600 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:22:02.548594 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls podName:66b484ea-bec9-4827-98ab-a4d55ea83c6e nodeName:}" failed. No retries permitted until 2026-06-11 15:22:03.04857611 +0000 UTC m=+272.064727380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-gbbv9" (UID: "66b484ea-bec9-4827-98ab-a4d55ea83c6e") : secret "prometheus-operator-tls" not found Jun 11 15:22:02.548876 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.548856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b484ea-bec9-4827-98ab-a4d55ea83c6e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.550802 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.550764 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:02.558516 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:02.558488 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wvpb\" (UniqueName: \"kubernetes.io/projected/66b484ea-bec9-4827-98ab-a4d55ea83c6e-kube-api-access-2wvpb\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:03.051380 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:03.051344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:03.051572 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:22:03.051520 2574 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 11 15:22:03.051642 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:22:03.051597 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls podName:66b484ea-bec9-4827-98ab-a4d55ea83c6e nodeName:}" failed. No retries permitted until 2026-06-11 15:22:04.051574868 +0000 UTC m=+273.067726137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-gbbv9" (UID: "66b484ea-bec9-4827-98ab-a4d55ea83c6e") : secret "prometheus-operator-tls" not found Jun 11 15:22:03.253470 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:03.253434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44h45" event={"ID":"b1c997db-cf65-453e-a84f-94c71b34f4ac","Type":"ContainerStarted","Data":"91f772771b811b38b6efd0d0187e28fe2e399e13d4994e1f7cac10f070db50d3"} Jun 11 15:22:03.272903 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:03.272857 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-44h45" podStartSLOduration=1.882365045 podStartE2EDuration="4.272843116s" totalImagesPullingTime="2.390478071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:21:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:03.27180698 +0000 UTC m=+272.287958258" watchObservedRunningTime="2026-06-11 15:22:03.272843116 +0000 UTC m=+272.288994391" Jun 11 15:22:04.059178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:04.059141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:04.061490 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:04.061471 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/66b484ea-bec9-4827-98ab-a4d55ea83c6e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-gbbv9\" (UID: \"66b484ea-bec9-4827-98ab-a4d55ea83c6e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:04.216948 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:04.216916 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" Jun 11 15:22:04.341570 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:04.341496 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9"] Jun 11 15:22:04.344791 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:22:04.344750 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b484ea_bec9_4827_98ab_a4d55ea83c6e.slice/crio-e63f0c6c6f30e4e7a285470f3ba7192f4f16126431b3a3d53dbd4ad85d1cd3d1 WatchSource:0}: Error finding container e63f0c6c6f30e4e7a285470f3ba7192f4f16126431b3a3d53dbd4ad85d1cd3d1: Status 404 returned error can't find the container with id e63f0c6c6f30e4e7a285470f3ba7192f4f16126431b3a3d53dbd4ad85d1cd3d1 Jun 11 15:22:05.260740 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:05.260705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" event={"ID":"66b484ea-bec9-4827-98ab-a4d55ea83c6e","Type":"ContainerStarted","Data":"e63f0c6c6f30e4e7a285470f3ba7192f4f16126431b3a3d53dbd4ad85d1cd3d1"} Jun 11 15:22:06.266358 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:06.266327 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" event={"ID":"66b484ea-bec9-4827-98ab-a4d55ea83c6e","Type":"ContainerStarted","Data":"6062ab756aa878b14f1407327b12f2860ec17e79ba053adf1b38151aabcdd957"} Jun 11 15:22:07.271612 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:07.271580 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" event={"ID":"66b484ea-bec9-4827-98ab-a4d55ea83c6e","Type":"ContainerStarted","Data":"9db5847e412587d7073f74ca7f02dc70bf084e7a644e6b4bf04fddc4d4d784f9"} Jun 11 15:22:07.288984 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:07.288937 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-gbbv9" podStartSLOduration=3.493353044 podStartE2EDuration="5.288922078s" totalImagesPullingTime="1.795569034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:07.288336085 +0000 UTC m=+276.304487360" watchObservedRunningTime="2026-06-11 15:22:07.288922078 +0000 UTC m=+276.305073352" Jun 11 15:22:08.848811 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:08.848763 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l5ht2"] Jun 11 15:22:08.880152 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:08.880125 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:08.886053 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:08.886025 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b7xsk\"" Jun 11 15:22:08.886197 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:08.886099 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 15:22:08.886197 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:08.886171 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 15:22:08.886931 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:08.886906 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 15:22:09.004863 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.004828 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.004981 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.004869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-tls\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.004981 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.004884 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff833a9b-8ea3-4443-93f6-55d352977f46-metrics-client-ca\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.004981 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.004936 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-wtmp\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.005090 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.004995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-root\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.005090 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.005021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbccl\" (UniqueName: \"kubernetes.io/projected/ff833a9b-8ea3-4443-93f6-55d352977f46-kube-api-access-tbccl\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.005090 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.005049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.005090 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.005084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-textfile\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.005211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.005119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-sys\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106167 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106167 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-tls\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106379 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff833a9b-8ea3-4443-93f6-55d352977f46-metrics-client-ca\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106379 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106202 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-wtmp\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106379 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106256 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-root\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106379 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106287 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbccl\" (UniqueName: \"kubernetes.io/projected/ff833a9b-8ea3-4443-93f6-55d352977f46-kube-api-access-tbccl\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106379 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106379 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106373 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-textfile\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106685 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-sys\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106685 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-sys\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106685 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106579 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-root\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106685 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106584 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-wtmp\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106911 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106878 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff833a9b-8ea3-4443-93f6-55d352977f46-metrics-client-ca\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.106959 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.106926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-textfile\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.107153 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.107122 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-accelerators-collector-config\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.108585 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.108567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-tls\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.109151 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.109130 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff833a9b-8ea3-4443-93f6-55d352977f46-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.114593 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.114575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbccl\" (UniqueName: \"kubernetes.io/projected/ff833a9b-8ea3-4443-93f6-55d352977f46-kube-api-access-tbccl\") pod \"node-exporter-l5ht2\" (UID: \"ff833a9b-8ea3-4443-93f6-55d352977f46\") " pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.188937 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.188911 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l5ht2" Jun 11 15:22:09.225519 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:22:09.225491 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff833a9b_8ea3_4443_93f6_55d352977f46.slice/crio-6277afef4f91a5a5a7873600db11e19c806b3be65348ba68129ad919473f4e1e WatchSource:0}: Error finding container 6277afef4f91a5a5a7873600db11e19c806b3be65348ba68129ad919473f4e1e: Status 404 returned error can't find the container with id 6277afef4f91a5a5a7873600db11e19c806b3be65348ba68129ad919473f4e1e Jun 11 15:22:09.279120 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.279089 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5ht2" event={"ID":"ff833a9b-8ea3-4443-93f6-55d352977f46","Type":"ContainerStarted","Data":"6277afef4f91a5a5a7873600db11e19c806b3be65348ba68129ad919473f4e1e"} Jun 11 15:22:09.858487 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.858453 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:09.862283 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.862260 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:09.865438 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.865284 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:22:09.867630 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.867595 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:22:09.868141 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.867811 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:22:09.868141 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.867849 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:22:09.868141 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.868003 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:22:09.868141 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.868034 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:22:09.868141 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.868125 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:22:09.868449 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.868197 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:22:09.868449 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.868247 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ddwbg\"" Jun 11 15:22:09.868827 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.868631 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:22:09.882829 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:09.882804 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:10.014401 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014378 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-volume\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014486 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014526 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014509 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-web-config\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014561 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014639 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014639 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gnf6\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-kube-api-access-5gnf6\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014711 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014711 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014802 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014802 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014748 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-out\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014802 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014914 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.014914 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.014834 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115376 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115300 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115376 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115338 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-web-config\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115376 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115364 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gnf6\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-kube-api-access-5gnf6\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115515 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-out\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115589 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.115665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.115671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-volume\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.116887 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.116628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.116887 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.116659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.117829 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.117444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.118484 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.118454 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.119141 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.119095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-volume\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.119377 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.119351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-web-config\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.119655 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.119601 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.119842 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.119819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-out\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.119921 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.119821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.120072 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.120051 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.120223 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.120205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.120893 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.120872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.123882 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.123857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gnf6\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-kube-api-access-5gnf6\") pod \"alertmanager-main-0\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.174655 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.174632 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:22:10.284613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.284580 2574 generic.go:356] "Generic (PLEG): container finished" podID="ff833a9b-8ea3-4443-93f6-55d352977f46" containerID="f0a7f230e1666abfcd2336b9d71aa70ca43a4c570f2ae5acb826c525cda21fc3" exitCode=0 Jun 11 15:22:10.284750 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.284636 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5ht2" event={"ID":"ff833a9b-8ea3-4443-93f6-55d352977f46","Type":"ContainerDied","Data":"f0a7f230e1666abfcd2336b9d71aa70ca43a4c570f2ae5acb826c525cda21fc3"} Jun 11 15:22:10.305544 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:10.305514 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:22:10.306291 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:22:10.306246 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod694f0763_a1e2_4022_b356_a09a0e6f1be4.slice/crio-97b6c9a365311641a25dd2ad05b373c9a3dbff8890eb9a9360dcafca2c1539e2 WatchSource:0}: Error finding container 97b6c9a365311641a25dd2ad05b373c9a3dbff8890eb9a9360dcafca2c1539e2: Status 404 returned error can't find the container with id 97b6c9a365311641a25dd2ad05b373c9a3dbff8890eb9a9360dcafca2c1539e2 Jun 11 15:22:11.289702 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:11.289665 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5ht2" event={"ID":"ff833a9b-8ea3-4443-93f6-55d352977f46","Type":"ContainerStarted","Data":"a5d967b435716efc4b474cc6dcb18c5510518be0fab72288639ddc0b367909b8"} Jun 11 15:22:11.290269 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:11.289724 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l5ht2" event={"ID":"ff833a9b-8ea3-4443-93f6-55d352977f46","Type":"ContainerStarted","Data":"c2c2b9ab8836473c75d0a6a4aedfbc95a700e8788da09c9a490a9f56e41bdf42"} Jun 11 15:22:11.291226 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:11.291207 2574 generic.go:356] "Generic (PLEG): container finished" podID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerID="312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1" exitCode=0 Jun 11 15:22:11.291284 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:11.291261 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerDied","Data":"312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1"} Jun 11 15:22:11.291326 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:11.291304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerStarted","Data":"97b6c9a365311641a25dd2ad05b373c9a3dbff8890eb9a9360dcafca2c1539e2"} Jun 11 15:22:11.312328 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:11.312283 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l5ht2" podStartSLOduration=2.462421484 podStartE2EDuration="3.312270159s" totalImagesPullingTime="782.174662ms" totalInitContainerRuntime="67.674013ms" isStatefulPod=true podCreationTimestamp="2026-06-11 15:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:11.310983088 +0000 UTC m=+280.327134363" watchObservedRunningTime="2026-06-11 15:22:11.312270159 +0000 UTC m=+280.328421443" Jun 11 15:22:11.914644 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:22:11.914604 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-57f95779c-xjscb" podUID="190db870-eaf1-40e2-8511-5e2a34a4b36b" Jun 11 15:22:11.914644 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:22:11.914602 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qq7h7" podUID="8221e5a8-dc66-4499-a9d7-ac824f4ce656" Jun 11 15:22:12.295781 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:12.295734 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qq7h7" Jun 11 15:22:12.295781 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:12.295738 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:22:13.194264 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.194235 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5ff99777bd-vnhwf"] Jun 11 15:22:13.197472 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.197457 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.200446 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.200413 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-er7b7mr8i921p\"" Jun 11 15:22:13.200446 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.200435 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 15:22:13.200446 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.200436 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 15:22:13.200683 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.200437 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 15:22:13.200683 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.200447 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 15:22:13.200683 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.200660 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-g5s6j\"" Jun 11 15:22:13.206670 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.206649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5ff99777bd-vnhwf"] Jun 11 15:22:13.303451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.303407 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerStarted","Data":"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a"} Jun 11 15:22:13.303915 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.303475 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerStarted","Data":"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7"} Jun 11 15:22:13.303915 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.303509 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerStarted","Data":"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d"} Jun 11 15:22:13.303915 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.303545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerStarted","Data":"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02"} Jun 11 15:22:13.303915 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.303627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerStarted","Data":"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe"} Jun 11 15:22:13.346517 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.346484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwpgf\" (UniqueName: \"kubernetes.io/projected/aee30fb5-015d-4369-95f6-7a163e3cdb1d-kube-api-access-gwpgf\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.346517 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.346523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aee30fb5-015d-4369-95f6-7a163e3cdb1d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.346749 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.346590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aee30fb5-015d-4369-95f6-7a163e3cdb1d-audit-log\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.346749 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.346638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-client-ca-bundle\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.346749 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.346683 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aee30fb5-015d-4369-95f6-7a163e3cdb1d-metrics-server-audit-profiles\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.346749 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.346736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-secret-metrics-server-client-certs\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.346934 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.346870 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-secret-metrics-server-tls\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.447794 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.447703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-client-ca-bundle\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.447794 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.447754 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aee30fb5-015d-4369-95f6-7a163e3cdb1d-metrics-server-audit-profiles\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.448019 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.447827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-secret-metrics-server-client-certs\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.448019 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.447868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-secret-metrics-server-tls\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.448204 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.448169 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwpgf\" (UniqueName: \"kubernetes.io/projected/aee30fb5-015d-4369-95f6-7a163e3cdb1d-kube-api-access-gwpgf\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.448325 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.448226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aee30fb5-015d-4369-95f6-7a163e3cdb1d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.448325 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.448257 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aee30fb5-015d-4369-95f6-7a163e3cdb1d-audit-log\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.448649 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.448626 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aee30fb5-015d-4369-95f6-7a163e3cdb1d-audit-log\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.449065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.449044 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aee30fb5-015d-4369-95f6-7a163e3cdb1d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.449201 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.449114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aee30fb5-015d-4369-95f6-7a163e3cdb1d-metrics-server-audit-profiles\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.450826 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.450797 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-secret-metrics-server-tls\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.450930 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.450799 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-client-ca-bundle\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.450930 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.450864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aee30fb5-015d-4369-95f6-7a163e3cdb1d-secret-metrics-server-client-certs\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.458256 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.458237 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwpgf\" (UniqueName: \"kubernetes.io/projected/aee30fb5-015d-4369-95f6-7a163e3cdb1d-kube-api-access-gwpgf\") pod \"metrics-server-5ff99777bd-vnhwf\" (UID: \"aee30fb5-015d-4369-95f6-7a163e3cdb1d\") " pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.507738 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.507700 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:13.649945 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:13.649911 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5ff99777bd-vnhwf"] Jun 11 15:22:13.652130 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:22:13.652108 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee30fb5_015d_4369_95f6_7a163e3cdb1d.slice/crio-7f8da7f89b1b2a74d3a619650c16d4ddc27b495d8f196820a4aacb2039169fee WatchSource:0}: Error finding container 7f8da7f89b1b2a74d3a619650c16d4ddc27b495d8f196820a4aacb2039169fee: Status 404 returned error can't find the container with id 7f8da7f89b1b2a74d3a619650c16d4ddc27b495d8f196820a4aacb2039169fee Jun 11 15:22:14.025263 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.025226 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m"] Jun 11 15:22:14.028704 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.028684 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.030974 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.030944 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 15:22:14.031111 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.031018 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kc9ld\"" Jun 11 15:22:14.031111 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.031027 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 15:22:14.031111 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.031082 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 15:22:14.031111 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.031023 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 15:22:14.031334 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.031322 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 15:22:14.036429 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.036411 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 15:22:14.041492 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.041465 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m"] Jun 11 15:22:14.160237 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.160196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-telemeter-client-tls\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.160422 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.160262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.160422 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.160323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-metrics-client-ca\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.160422 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.160391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-federate-client-tls\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.160595 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.160470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.160595 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.160502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-secret-telemeter-client\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.160595 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.160567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zth2n\" (UniqueName: \"kubernetes.io/projected/d3b0bd9f-22fb-478c-9412-680d67d8eef0-kube-api-access-zth2n\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.160705 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.160598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-serving-certs-ca-bundle\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.261580 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.261541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-metrics-client-ca\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.261792 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.261604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-federate-client-tls\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.261792 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.261660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.261792 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.261691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-secret-telemeter-client\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.261792 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.261746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zth2n\" (UniqueName: \"kubernetes.io/projected/d3b0bd9f-22fb-478c-9412-680d67d8eef0-kube-api-access-zth2n\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.262043 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.261798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-serving-certs-ca-bundle\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.262043 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.261837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-telemeter-client-tls\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.262429 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.262234 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.262557 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.262425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-metrics-client-ca\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.262678 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.262654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.262850 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.262822 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3b0bd9f-22fb-478c-9412-680d67d8eef0-serving-certs-ca-bundle\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.264546 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.264519 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-telemeter-client-tls\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.265074 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.265043 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-federate-client-tls\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.265517 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.265495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.265613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.265571 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3b0bd9f-22fb-478c-9412-680d67d8eef0-secret-telemeter-client\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.271103 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.271079 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zth2n\" (UniqueName: \"kubernetes.io/projected/d3b0bd9f-22fb-478c-9412-680d67d8eef0-kube-api-access-zth2n\") pod \"telemeter-client-6c6dcbf54d-95v5m\" (UID: \"d3b0bd9f-22fb-478c-9412-680d67d8eef0\") " pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.311622 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.311524 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerStarted","Data":"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b"} Jun 11 15:22:14.313060 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.313030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" event={"ID":"aee30fb5-015d-4369-95f6-7a163e3cdb1d","Type":"ContainerStarted","Data":"7f8da7f89b1b2a74d3a619650c16d4ddc27b495d8f196820a4aacb2039169fee"} Jun 11 15:22:14.338407 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.338355 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" Jun 11 15:22:14.340354 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.340292 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.509922218 podStartE2EDuration="5.340271526s" totalImagesPullingTime="2.811336532s" totalInitContainerRuntime="19.012776ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:14.338589319 +0000 UTC m=+283.354740594" watchObservedRunningTime="2026-06-11 15:22:14.340271526 +0000 UTC m=+283.356422803" Jun 11 15:22:14.503875 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:14.503841 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m"] Jun 11 15:22:14.507284 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:22:14.507254 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b0bd9f_22fb_478c_9412_680d67d8eef0.slice/crio-1d6bdb7452e9cb5d445f2778835d4087a7dcfdca80829fdbaeed5d2562b238f5 WatchSource:0}: Error finding container 1d6bdb7452e9cb5d445f2778835d4087a7dcfdca80829fdbaeed5d2562b238f5: Status 404 returned error can't find the container with id 1d6bdb7452e9cb5d445f2778835d4087a7dcfdca80829fdbaeed5d2562b238f5 Jun 11 15:22:15.025040 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.023079 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:15.028851 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.028824 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.031396 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.031365 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:22:15.031533 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.031368 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:22:15.032026 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032009 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:22:15.032498 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032469 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:22:15.032607 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032521 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:22:15.032607 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032562 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:22:15.032607 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032577 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:22:15.032607 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032599 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-66d5t\"" Jun 11 15:22:15.032920 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032717 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3jsspjddjeadv\"" Jun 11 15:22:15.032920 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032865 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:22:15.032920 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.032895 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:22:15.033073 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.033044 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:22:15.033073 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.033069 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:22:15.033176 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.033083 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:22:15.033354 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.033268 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:22:15.035524 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.035487 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:22:15.043695 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.043610 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:15.172133 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172295 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172295 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172295 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172202 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172295 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172296 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172336 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172382 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172399 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172444 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm6jn\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-kube-api-access-vm6jn\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172833 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172833 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172833 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172833 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172833 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172833 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.172833 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.172818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.273765 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273723 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.273765 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm6jn\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-kube-api-access-vm6jn\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273829 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273858 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:22:15.274044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273929 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273958 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:22:15.274044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.273996 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274127 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.274417 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.275012 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.274977 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.279402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.275543 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.279402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.275955 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.279402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.276583 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.279402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.278965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.279402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.279213 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.279749 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.279545 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8221e5a8-dc66-4499-a9d7-ac824f4ce656-metrics-tls\") pod \"dns-default-qq7h7\" (UID: \"8221e5a8-dc66-4499-a9d7-ac824f4ce656\") " pod="openshift-dns/dns-default-qq7h7" Jun 11 15:22:15.281758 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.281415 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.281758 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.281686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.281758 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.281696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"image-registry-57f95779c-xjscb\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:22:15.282072 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.281851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.282072 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.281966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.282872 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.282831 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-web-config\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.283134 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.282970 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.283605 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.283578 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.285189 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.284734 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.285189 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.284841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.285189 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.285036 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.285189 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.285146 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.285868 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.285844 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config-out\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.286747 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.286727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.287981 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.287959 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm6jn\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-kube-api-access-vm6jn\") pod \"prometheus-k8s-0\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.299236 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.299209 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cspmp\"" Jun 11 15:22:15.299372 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.299295 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jps6d\"" Jun 11 15:22:15.307256 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.307116 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:22:15.307592 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.307280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qq7h7" Jun 11 15:22:15.320431 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.320400 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" event={"ID":"d3b0bd9f-22fb-478c-9412-680d67d8eef0","Type":"ContainerStarted","Data":"1d6bdb7452e9cb5d445f2778835d4087a7dcfdca80829fdbaeed5d2562b238f5"} Jun 11 15:22:15.322220 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.322190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" event={"ID":"aee30fb5-015d-4369-95f6-7a163e3cdb1d","Type":"ContainerStarted","Data":"aff274628547ee9528a5be66af9bfeafb22b79bbd768a390a0ce85892936f6d2"} Jun 11 15:22:15.344192 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.343935 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" podStartSLOduration=0.900529769 podStartE2EDuration="2.343913648s" totalImagesPullingTime="1.443383879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:15.341802657 +0000 UTC m=+284.357953953" watchObservedRunningTime="2026-06-11 15:22:15.343913648 +0000 UTC m=+284.360064924" Jun 11 15:22:15.344929 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.344686 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:15.513916 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.512872 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qq7h7"] Jun 11 15:22:15.518704 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:22:15.518673 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8221e5a8_dc66_4499_a9d7_ac824f4ce656.slice/crio-9362aa8f4793a557d44f699c809628c59ce0d88acc32e41e6eb89d8d3a4caa49 WatchSource:0}: Error finding container 9362aa8f4793a557d44f699c809628c59ce0d88acc32e41e6eb89d8d3a4caa49: Status 404 returned error can't find the container with id 9362aa8f4793a557d44f699c809628c59ce0d88acc32e41e6eb89d8d3a4caa49 Jun 11 15:22:15.539337 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.536684 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-57f95779c-xjscb"] Jun 11 15:22:15.559515 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:15.559490 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:22:15.561839 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:22:15.561810 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e927953_353e_47d8_9bd2_9ce4b264a1c7.slice/crio-cdbb1ce177132a771a4624b99cd9ed41cf8fe06f3c769f8c68cb2649dd0604e1 WatchSource:0}: Error finding container cdbb1ce177132a771a4624b99cd9ed41cf8fe06f3c769f8c68cb2649dd0604e1: Status 404 returned error can't find the container with id cdbb1ce177132a771a4624b99cd9ed41cf8fe06f3c769f8c68cb2649dd0604e1 Jun 11 15:22:16.328234 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:16.328202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq7h7" event={"ID":"8221e5a8-dc66-4499-a9d7-ac824f4ce656","Type":"ContainerStarted","Data":"9362aa8f4793a557d44f699c809628c59ce0d88acc32e41e6eb89d8d3a4caa49"} Jun 11 15:22:16.330236 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:16.330203 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f95779c-xjscb" event={"ID":"190db870-eaf1-40e2-8511-5e2a34a4b36b","Type":"ContainerStarted","Data":"2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714"} Jun 11 15:22:16.330402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:16.330264 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:22:16.330402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:16.330285 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f95779c-xjscb" event={"ID":"190db870-eaf1-40e2-8511-5e2a34a4b36b","Type":"ContainerStarted","Data":"da9bc861feb9c7995636237bfb7f6c93c22014c9e6c6a87f95f2cab163345e2c"} Jun 11 15:22:16.331808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:16.331782 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerID="9c83ae5572dc9a2d7efd663d41e81f15e7fd4567206a163988e8f4af30757a4a" exitCode=0 Jun 11 15:22:16.331876 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:16.331864 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerDied","Data":"9c83ae5572dc9a2d7efd663d41e81f15e7fd4567206a163988e8f4af30757a4a"} Jun 11 15:22:16.331930 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:16.331919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerStarted","Data":"cdbb1ce177132a771a4624b99cd9ed41cf8fe06f3c769f8c68cb2649dd0604e1"} Jun 11 15:22:16.352721 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:16.352389 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-57f95779c-xjscb" podStartSLOduration=284.352367368 podStartE2EDuration="4m44.352367368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:16.350691137 +0000 UTC m=+285.366842413" watchObservedRunningTime="2026-06-11 15:22:16.352367368 +0000 UTC m=+285.368518644" Jun 11 15:22:17.340515 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:17.340378 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" event={"ID":"d3b0bd9f-22fb-478c-9412-680d67d8eef0","Type":"ContainerStarted","Data":"44d0d4a997b19ff4612b7638a20cffa963057858b5fec4e665a8517c0bc02996"} Jun 11 15:22:17.340515 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:17.340455 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" event={"ID":"d3b0bd9f-22fb-478c-9412-680d67d8eef0","Type":"ContainerStarted","Data":"6012e68f66bbd3e5151dfda71fdf938e67a61ebbf517787617a7d7a603058024"} Jun 11 15:22:17.340515 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:17.340484 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" event={"ID":"d3b0bd9f-22fb-478c-9412-680d67d8eef0","Type":"ContainerStarted","Data":"f4d457f0edfc10365fa6fa358797de065bd51e219e7e842f81b178a9b6d4e2ab"} Jun 11 15:22:17.364716 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:17.364630 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6c6dcbf54d-95v5m" podStartSLOduration=1.051933637 podStartE2EDuration="3.364605857s" totalImagesPullingTime="2.31267222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:17.363921203 +0000 UTC m=+286.380072484" watchObservedRunningTime="2026-06-11 15:22:17.364605857 +0000 UTC m=+286.380757149" Jun 11 15:22:18.349735 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:18.349670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq7h7" event={"ID":"8221e5a8-dc66-4499-a9d7-ac824f4ce656","Type":"ContainerStarted","Data":"a5575b094a97301915c5a4f473cad4326d8305ddd39a488eca690dfeb6fdcf18"} Jun 11 15:22:18.350209 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:18.349813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qq7h7" event={"ID":"8221e5a8-dc66-4499-a9d7-ac824f4ce656","Type":"ContainerStarted","Data":"5dfc986688571912d3e71382bbb4231574c2a0d9864368dc0331d5d7f7ca3e59"} Jun 11 15:22:18.350209 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:18.349849 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qq7h7" Jun 11 15:22:18.369944 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:18.369869 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qq7h7" podStartSLOduration=251.26125778 podStartE2EDuration="4m13.369847667s" totalImagesPullingTime="2.108589887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:18.368094333 +0000 UTC m=+287.384245608" watchObservedRunningTime="2026-06-11 15:22:18.369847667 +0000 UTC m=+287.385998944" Jun 11 15:22:20.362530 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:20.361601 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerStarted","Data":"1a33612035de92fea081ed5b787f372e2d0bf6d10c1a5abd4d89c08334c23251"} Jun 11 15:22:20.362530 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:20.361683 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerStarted","Data":"967520fdb41eda9527bcd4b2f53a33523c832000bf81546842083f8d10373531"} Jun 11 15:22:21.371189 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:21.371158 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerStarted","Data":"9cd07c5bf27d37a6ffc60e8a137ef24f8292013baf3f188b0d72c525f8928008"} Jun 11 15:22:22.378096 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:22.378060 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerStarted","Data":"77a2793dfd43310b0ea956c2720ea9316b60f9748000042322a002fda162d5ae"} Jun 11 15:22:22.378490 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:22.378153 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerStarted","Data":"f95dd6459dd081aee56d8ac916886f0e77b5cb342a5e141ab083790aa825bf35"} Jun 11 15:22:22.378490 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:22.378179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerStarted","Data":"30abf23af07411a6312c872e46c55479b786f2a757616fa35c0240a7756e46ea"} Jun 11 15:22:22.412747 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:22.412686 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.601127855 podStartE2EDuration="7.41266275s" totalImagesPullingTime="4.79182317s" totalInitContainerRuntime="19.711725ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:22:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:22:22.411062292 +0000 UTC m=+291.427213568" watchObservedRunningTime="2026-06-11 15:22:22.41266275 +0000 UTC m=+291.428814027" Jun 11 15:22:25.345976 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:25.345942 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:22:25.434257 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:22:25.434220 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-58xmz" podUID="053352ba-ba2b-4fa2-ab5c-ef62c4012e35" Jun 11 15:22:28.355933 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:28.355902 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qq7h7" Jun 11 15:22:31.402606 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:31.402558 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:22:31.404426 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:31.404406 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:22:31.413233 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:31.413213 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 15:22:32.088205 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:32.088171 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f95779c-xjscb"] Jun 11 15:22:32.092446 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:32.092413 2574 patch_prober.go:28] interesting pod/image-registry-57f95779c-xjscb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 15:22:32.092570 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:32.092470 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-57f95779c-xjscb" podUID="190db870-eaf1-40e2-8511-5e2a34a4b36b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 15:22:33.508171 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:33.508134 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:33.508567 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:33.508208 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:36.433404 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:36.433367 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:22:42.093349 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:42.093319 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:22:50.488073 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:50.488040 2574 generic.go:356] "Generic (PLEG): container finished" podID="c84c4908-c457-4fdb-a5dc-6daf89c2a503" containerID="d6daa7b4031ef5016cfb06f68c622d5f7b333ad57cd1eac263bdbd3c64cae07e" exitCode=0 Jun 11 15:22:50.488459 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:50.488118 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" event={"ID":"c84c4908-c457-4fdb-a5dc-6daf89c2a503","Type":"ContainerDied","Data":"d6daa7b4031ef5016cfb06f68c622d5f7b333ad57cd1eac263bdbd3c64cae07e"} Jun 11 15:22:50.488459 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:50.488449 2574 scope.go:117] "RemoveContainer" containerID="d6daa7b4031ef5016cfb06f68c622d5f7b333ad57cd1eac263bdbd3c64cae07e" Jun 11 15:22:51.493534 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:51.493500 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-scmcc" event={"ID":"c84c4908-c457-4fdb-a5dc-6daf89c2a503","Type":"ContainerStarted","Data":"0dbc7b4f3776391adc4da736ace1f576861c3e88d814e9636922a403c4146849"} Jun 11 15:22:53.513742 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:53.513711 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:53.517656 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:53.517627 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5ff99777bd-vnhwf" Jun 11 15:22:57.108023 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:57.107980 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-57f95779c-xjscb" podUID="190db870-eaf1-40e2-8511-5e2a34a4b36b" containerName="registry" containerID="cri-o://2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714" gracePeriod=30 Jun 11 15:22:58.354598 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.354572 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:22:58.392651 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.392620 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-trusted-ca\") pod \"190db870-eaf1-40e2-8511-5e2a34a4b36b\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " Jun 11 15:22:58.392651 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.392666 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-bound-sa-token\") pod \"190db870-eaf1-40e2-8511-5e2a34a4b36b\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " Jun 11 15:22:58.392920 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.392704 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-installation-pull-secrets\") pod \"190db870-eaf1-40e2-8511-5e2a34a4b36b\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " Jun 11 15:22:58.392920 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.392732 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/190db870-eaf1-40e2-8511-5e2a34a4b36b-ca-trust-extracted\") pod \"190db870-eaf1-40e2-8511-5e2a34a4b36b\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " Jun 11 15:22:58.392920 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.392805 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-image-registry-private-configuration\") pod \"190db870-eaf1-40e2-8511-5e2a34a4b36b\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " Jun 11 15:22:58.393193 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.393141 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "190db870-eaf1-40e2-8511-5e2a34a4b36b" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:58.393570 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.393469 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-certificates\") pod \"190db870-eaf1-40e2-8511-5e2a34a4b36b\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " Jun 11 15:22:58.393570 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.393520 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksdq8\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-kube-api-access-ksdq8\") pod \"190db870-eaf1-40e2-8511-5e2a34a4b36b\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " Jun 11 15:22:58.393871 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.393582 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") pod \"190db870-eaf1-40e2-8511-5e2a34a4b36b\" (UID: \"190db870-eaf1-40e2-8511-5e2a34a4b36b\") " Jun 11 15:22:58.393939 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.393909 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-trusted-ca\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:22:58.394478 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.394437 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "190db870-eaf1-40e2-8511-5e2a34a4b36b" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:22:58.395945 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.395708 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "190db870-eaf1-40e2-8511-5e2a34a4b36b" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:58.395945 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.395826 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "190db870-eaf1-40e2-8511-5e2a34a4b36b" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:22:58.395945 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.395911 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "190db870-eaf1-40e2-8511-5e2a34a4b36b" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:22:58.396176 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.396156 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "190db870-eaf1-40e2-8511-5e2a34a4b36b" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:22:58.396426 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.396399 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-kube-api-access-ksdq8" (OuterVolumeSpecName: "kube-api-access-ksdq8") pod "190db870-eaf1-40e2-8511-5e2a34a4b36b" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b"). InnerVolumeSpecName "kube-api-access-ksdq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:22:58.401799 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.401757 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/190db870-eaf1-40e2-8511-5e2a34a4b36b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "190db870-eaf1-40e2-8511-5e2a34a4b36b" (UID: "190db870-eaf1-40e2-8511-5e2a34a4b36b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:22:58.494425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.494326 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-certificates\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:22:58.494425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.494356 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksdq8\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-kube-api-access-ksdq8\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:22:58.494425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.494369 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-registry-tls\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:22:58.494425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.494380 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/190db870-eaf1-40e2-8511-5e2a34a4b36b-bound-sa-token\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:22:58.494425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.494391 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-installation-pull-secrets\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:22:58.494425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.494406 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/190db870-eaf1-40e2-8511-5e2a34a4b36b-ca-trust-extracted\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:22:58.494425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.494418 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/190db870-eaf1-40e2-8511-5e2a34a4b36b-image-registry-private-configuration\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:22:58.521297 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.521259 2574 generic.go:356] "Generic (PLEG): container finished" podID="190db870-eaf1-40e2-8511-5e2a34a4b36b" containerID="2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714" exitCode=0 Jun 11 15:22:58.521451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.521304 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-57f95779c-xjscb" Jun 11 15:22:58.521451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.521324 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f95779c-xjscb" event={"ID":"190db870-eaf1-40e2-8511-5e2a34a4b36b","Type":"ContainerDied","Data":"2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714"} Jun 11 15:22:58.521451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.521368 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-57f95779c-xjscb" event={"ID":"190db870-eaf1-40e2-8511-5e2a34a4b36b","Type":"ContainerDied","Data":"da9bc861feb9c7995636237bfb7f6c93c22014c9e6c6a87f95f2cab163345e2c"} Jun 11 15:22:58.521451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.521389 2574 scope.go:117] "RemoveContainer" containerID="2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714" Jun 11 15:22:58.530099 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.530078 2574 scope.go:117] "RemoveContainer" containerID="2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714" Jun 11 15:22:58.530408 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:22:58.530387 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714\": container with ID starting with 2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714 not found: ID does not exist" containerID="2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714" Jun 11 15:22:58.530472 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.530415 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714"} err="failed to get container status \"2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714\": rpc error: code = NotFound desc = could not find container \"2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714\": container with ID starting with 2002ae571bcecea3b7473daca4782ebdd45063211e028e992750ca1632947714 not found: ID does not exist" Jun 11 15:22:58.545697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.545667 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-57f95779c-xjscb"] Jun 11 15:22:58.552362 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:58.552336 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-57f95779c-xjscb"] Jun 11 15:22:59.439802 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:22:59.439757 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="190db870-eaf1-40e2-8511-5e2a34a4b36b" path="/var/lib/kubelet/pods/190db870-eaf1-40e2-8511-5e2a34a4b36b/volumes" Jun 11 15:23:00.536935 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:00.536901 2574 generic.go:356] "Generic (PLEG): container finished" podID="5996d218-4517-4fa2-bcbe-382499f0e7bf" containerID="85d4757dcf1366a1bc9a2b97b9e980f5af8784a3414fa8a3b798b26ebd0288e9" exitCode=0 Jun 11 15:23:00.537339 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:00.536940 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-p7qgn" event={"ID":"5996d218-4517-4fa2-bcbe-382499f0e7bf","Type":"ContainerDied","Data":"85d4757dcf1366a1bc9a2b97b9e980f5af8784a3414fa8a3b798b26ebd0288e9"} Jun 11 15:23:00.537339 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:00.537303 2574 scope.go:117] "RemoveContainer" containerID="85d4757dcf1366a1bc9a2b97b9e980f5af8784a3414fa8a3b798b26ebd0288e9" Jun 11 15:23:01.178888 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:01.178860 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d85cd65c-l7d8c_ef735c11-5522-481c-a960-49e0fbee63da/router/0.log" Jun 11 15:23:01.200427 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:01.200405 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdf75_c763b42a-b789-418f-947e-24f064579283/serve-healthcheck-canary/0.log" Jun 11 15:23:01.541993 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:01.541958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-p7qgn" event={"ID":"5996d218-4517-4fa2-bcbe-382499f0e7bf","Type":"ContainerStarted","Data":"65600c5c569c33c2245539a40c46e39f14143e5a99532af987ab49a600289061"} Jun 11 15:23:15.345627 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:15.345594 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:15.361344 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:15.361313 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:15.612799 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:15.612709 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:29.185088 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.185048 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:23:29.185498 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.185331 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="alertmanager" containerID="cri-o://4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe" gracePeriod=120 Jun 11 15:23:29.185498 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.185417 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy" containerID="cri-o://55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7" gracePeriod=120 Jun 11 15:23:29.185498 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.185447 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="config-reloader" containerID="cri-o://dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02" gracePeriod=120 Jun 11 15:23:29.185498 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.185402 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy-web" containerID="cri-o://32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d" gracePeriod=120 Jun 11 15:23:29.185726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.185469 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="prom-label-proxy" containerID="cri-o://820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b" gracePeriod=120 Jun 11 15:23:29.185726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.185399 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy-metric" containerID="cri-o://78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a" gracePeriod=120 Jun 11 15:23:29.656706 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.656626 2574 generic.go:356] "Generic (PLEG): container finished" podID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerID="820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b" exitCode=0 Jun 11 15:23:29.656706 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.656650 2574 generic.go:356] "Generic (PLEG): container finished" podID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerID="55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7" exitCode=0 Jun 11 15:23:29.656706 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.656656 2574 generic.go:356] "Generic (PLEG): container finished" podID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerID="dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02" exitCode=0 Jun 11 15:23:29.656706 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.656662 2574 generic.go:356] "Generic (PLEG): container finished" podID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerID="4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe" exitCode=0 Jun 11 15:23:29.656706 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.656695 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerDied","Data":"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b"} Jun 11 15:23:29.656985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.656756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerDied","Data":"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7"} Jun 11 15:23:29.656985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.656796 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerDied","Data":"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02"} Jun 11 15:23:29.656985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:29.656822 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerDied","Data":"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe"} Jun 11 15:23:30.436662 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.436638 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.583436 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583334 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-metrics-client-ca\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583436 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583384 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-out\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583436 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583408 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-volume\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583436 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583434 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-web-config\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583453 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-main-tls\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583471 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-main-db\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583502 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583519 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-tls-assets\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583568 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-cluster-tls-config\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583607 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583632 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-trusted-ca-bundle\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583660 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gnf6\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-kube-api-access-5gnf6\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.583808 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583697 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-web\") pod \"694f0763-a1e2-4022-b356-a09a0e6f1be4\" (UID: \"694f0763-a1e2-4022-b356-a09a0e6f1be4\") " Jun 11 15:23:30.584269 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.583828 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:30.584269 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.584094 2574 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-metrics-client-ca\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.585045 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.584615 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:23:30.585176 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.585136 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:30.586379 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.586348 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-volume" (OuterVolumeSpecName: "config-volume") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:30.587539 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.587494 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:23:30.587539 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.587519 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:30.587709 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.587575 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:30.587917 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.587807 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:30.587917 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.587893 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-kube-api-access-5gnf6" (OuterVolumeSpecName: "kube-api-access-5gnf6") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "kube-api-access-5gnf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:23:30.588141 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.588122 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-out" (OuterVolumeSpecName: "config-out") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:23:30.588234 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.588215 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:30.593046 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.593011 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:30.599477 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.599454 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-web-config" (OuterVolumeSpecName: "web-config") pod "694f0763-a1e2-4022-b356-a09a0e6f1be4" (UID: "694f0763-a1e2-4022-b356-a09a0e6f1be4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:30.663413 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.663379 2574 generic.go:356] "Generic (PLEG): container finished" podID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerID="78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a" exitCode=0 Jun 11 15:23:30.663413 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.663404 2574 generic.go:356] "Generic (PLEG): container finished" podID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerID="32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d" exitCode=0 Jun 11 15:23:30.663624 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.663451 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.663624 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.663455 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerDied","Data":"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a"} Jun 11 15:23:30.663624 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.663549 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerDied","Data":"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d"} Jun 11 15:23:30.663624 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.663578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"694f0763-a1e2-4022-b356-a09a0e6f1be4","Type":"ContainerDied","Data":"97b6c9a365311641a25dd2ad05b373c9a3dbff8890eb9a9360dcafca2c1539e2"} Jun 11 15:23:30.663624 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.663608 2574 scope.go:117] "RemoveContainer" containerID="820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b" Jun 11 15:23:30.672334 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.672206 2574 scope.go:117] "RemoveContainer" containerID="78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a" Jun 11 15:23:30.679835 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.679816 2574 scope.go:117] "RemoveContainer" containerID="55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7" Jun 11 15:23:30.685119 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685098 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-out\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685119 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685118 2574 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-config-volume\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685128 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-web-config\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685138 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-main-tls\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685149 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-main-db\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685159 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685167 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-tls-assets\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685175 2574 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-cluster-tls-config\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685184 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685193 2574 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/694f0763-a1e2-4022-b356-a09a0e6f1be4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685201 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gnf6\" (UniqueName: \"kubernetes.io/projected/694f0763-a1e2-4022-b356-a09a0e6f1be4-kube-api-access-5gnf6\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.685231 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.685210 2574 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/694f0763-a1e2-4022-b356-a09a0e6f1be4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:30.687137 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.687123 2574 scope.go:117] "RemoveContainer" containerID="32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d" Jun 11 15:23:30.691443 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.691418 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:23:30.695147 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.695128 2574 scope.go:117] "RemoveContainer" containerID="dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02" Jun 11 15:23:30.696705 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.696682 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:23:30.702455 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.702436 2574 scope.go:117] "RemoveContainer" containerID="4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe" Jun 11 15:23:30.709882 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.709859 2574 scope.go:117] "RemoveContainer" containerID="312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1" Jun 11 15:23:30.717219 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.717201 2574 scope.go:117] "RemoveContainer" containerID="820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b" Jun 11 15:23:30.717513 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:23:30.717493 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b\": container with ID starting with 820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b not found: ID does not exist" containerID="820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b" Jun 11 15:23:30.717565 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.717523 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b"} err="failed to get container status \"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b\": rpc error: code = NotFound desc = could not find container \"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b\": container with ID starting with 820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b not found: ID does not exist" Jun 11 15:23:30.717565 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.717542 2574 scope.go:117] "RemoveContainer" containerID="78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a" Jun 11 15:23:30.717820 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:23:30.717802 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a\": container with ID starting with 78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a not found: ID does not exist" containerID="78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a" Jun 11 15:23:30.717879 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.717825 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a"} err="failed to get container status \"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a\": rpc error: code = NotFound desc = could not find container \"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a\": container with ID starting with 78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a not found: ID does not exist" Jun 11 15:23:30.717879 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.717841 2574 scope.go:117] "RemoveContainer" containerID="55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7" Jun 11 15:23:30.718099 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:23:30.718075 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7\": container with ID starting with 55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7 not found: ID does not exist" containerID="55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7" Jun 11 15:23:30.718138 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.718104 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7"} err="failed to get container status \"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7\": rpc error: code = NotFound desc = could not find container \"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7\": container with ID starting with 55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7 not found: ID does not exist" Jun 11 15:23:30.718138 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.718117 2574 scope.go:117] "RemoveContainer" containerID="32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d" Jun 11 15:23:30.718320 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:23:30.718304 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d\": container with ID starting with 32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d not found: ID does not exist" containerID="32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d" Jun 11 15:23:30.718362 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.718325 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d"} err="failed to get container status \"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d\": rpc error: code = NotFound desc = could not find container \"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d\": container with ID starting with 32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d not found: ID does not exist" Jun 11 15:23:30.718362 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.718340 2574 scope.go:117] "RemoveContainer" containerID="dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02" Jun 11 15:23:30.718573 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:23:30.718557 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02\": container with ID starting with dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02 not found: ID does not exist" containerID="dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02" Jun 11 15:23:30.718623 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.718576 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02"} err="failed to get container status \"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02\": rpc error: code = NotFound desc = could not find container \"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02\": container with ID starting with dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02 not found: ID does not exist" Jun 11 15:23:30.718623 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.718589 2574 scope.go:117] "RemoveContainer" containerID="4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe" Jun 11 15:23:30.718847 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:23:30.718831 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe\": container with ID starting with 4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe not found: ID does not exist" containerID="4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe" Jun 11 15:23:30.718913 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.718850 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe"} err="failed to get container status \"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe\": rpc error: code = NotFound desc = could not find container \"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe\": container with ID starting with 4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe not found: ID does not exist" Jun 11 15:23:30.718913 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.718872 2574 scope.go:117] "RemoveContainer" containerID="312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1" Jun 11 15:23:30.719048 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:23:30.719035 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1\": container with ID starting with 312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1 not found: ID does not exist" containerID="312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1" Jun 11 15:23:30.719092 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719051 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1"} err="failed to get container status \"312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1\": rpc error: code = NotFound desc = could not find container \"312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1\": container with ID starting with 312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1 not found: ID does not exist" Jun 11 15:23:30.719092 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719064 2574 scope.go:117] "RemoveContainer" containerID="820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b" Jun 11 15:23:30.719260 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719245 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b"} err="failed to get container status \"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b\": rpc error: code = NotFound desc = could not find container \"820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b\": container with ID starting with 820cfeab59247c533524722fe92bed233d6b7a89132410f0521ac5fd70041c7b not found: ID does not exist" Jun 11 15:23:30.719260 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719258 2574 scope.go:117] "RemoveContainer" containerID="78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a" Jun 11 15:23:30.719450 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719435 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a"} err="failed to get container status \"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a\": rpc error: code = NotFound desc = could not find container \"78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a\": container with ID starting with 78223b2b055b12f6d19bf95c65dafef1028395959ef73af1af9b370b1f41772a not found: ID does not exist" Jun 11 15:23:30.719493 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719450 2574 scope.go:117] "RemoveContainer" containerID="55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7" Jun 11 15:23:30.719665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719648 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7"} err="failed to get container status \"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7\": rpc error: code = NotFound desc = could not find container \"55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7\": container with ID starting with 55b1445e03657c60cb01b59d05142335d00ad6c2eb998d4b4fdd311916444ae7 not found: ID does not exist" Jun 11 15:23:30.719721 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719666 2574 scope.go:117] "RemoveContainer" containerID="32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d" Jun 11 15:23:30.719881 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719861 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d"} err="failed to get container status \"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d\": rpc error: code = NotFound desc = could not find container \"32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d\": container with ID starting with 32a5e0f2ac39480e2ebff717c03fd630632d563cac7bfa3e7675b30c8259492d not found: ID does not exist" Jun 11 15:23:30.719881 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.719879 2574 scope.go:117] "RemoveContainer" containerID="dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02" Jun 11 15:23:30.720105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.720088 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02"} err="failed to get container status \"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02\": rpc error: code = NotFound desc = could not find container \"dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02\": container with ID starting with dda90653e07da30a80089ef8fdef926ffe80f0a3189b0ea38703ed677e586f02 not found: ID does not exist" Jun 11 15:23:30.720151 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.720106 2574 scope.go:117] "RemoveContainer" containerID="4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe" Jun 11 15:23:30.720316 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.720299 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe"} err="failed to get container status \"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe\": rpc error: code = NotFound desc = could not find container \"4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe\": container with ID starting with 4999ecbbd429a443f8e255e94bef4646c3f1ccf753dfb3389e6be8d208bb5ebe not found: ID does not exist" Jun 11 15:23:30.720387 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.720316 2574 scope.go:117] "RemoveContainer" containerID="312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1" Jun 11 15:23:30.720552 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.720529 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1"} err="failed to get container status \"312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1\": rpc error: code = NotFound desc = could not find container \"312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1\": container with ID starting with 312ceedfe3901818bd100a996143847c3d9fe72f2cfa8b909effda6da34086a1 not found: ID does not exist" Jun 11 15:23:30.727786 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.727748 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:23:30.728151 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728110 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="190db870-eaf1-40e2-8511-5e2a34a4b36b" containerName="registry" Jun 11 15:23:30.728151 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728130 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="190db870-eaf1-40e2-8511-5e2a34a4b36b" containerName="registry" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728155 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="prom-label-proxy" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728163 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="prom-label-proxy" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728182 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="alertmanager" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728190 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="alertmanager" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728203 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="config-reloader" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728211 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="config-reloader" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728220 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy-web" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728230 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy-web" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728241 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="init-config-reloader" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728250 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="init-config-reloader" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728265 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728273 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy" Jun 11 15:23:30.728278 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728283 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy-metric" Jun 11 15:23:30.729001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728291 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy-metric" Jun 11 15:23:30.729001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728377 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="config-reloader" Jun 11 15:23:30.729001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728391 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="alertmanager" Jun 11 15:23:30.729001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728402 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy-metric" Jun 11 15:23:30.729001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728412 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy" Jun 11 15:23:30.729001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728422 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="kube-rbac-proxy-web" Jun 11 15:23:30.729001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728430 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" containerName="prom-label-proxy" Jun 11 15:23:30.729001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.728440 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="190db870-eaf1-40e2-8511-5e2a34a4b36b" containerName="registry" Jun 11 15:23:30.733818 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.733800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.736405 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.736387 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 15:23:30.736495 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.736390 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 15:23:30.736865 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.736847 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 15:23:30.737001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.736979 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 15:23:30.737176 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.737145 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ddwbg\"" Jun 11 15:23:30.737247 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.737191 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 15:23:30.737365 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.737338 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 15:23:30.737477 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.737457 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 15:23:30.737726 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.737710 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 15:23:30.743863 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.743845 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 15:23:30.749284 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.749259 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:23:30.886168 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886310 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886310 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886310 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886310 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-web-config\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886448 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886365 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886448 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886391 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-config-volume\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886448 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxjr\" (UniqueName: \"kubernetes.io/projected/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-kube-api-access-mfxjr\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886595 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886595 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886694 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886625 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886743 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886703 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-config-out\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.886743 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.886736 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.987981 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.987935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.987991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988086 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-config-out\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988113 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988487 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988198 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988487 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988487 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-web-config\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988487 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988487 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-config-volume\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.988487 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxjr\" (UniqueName: \"kubernetes.io/projected/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-kube-api-access-mfxjr\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.989205 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.988815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.989205 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.989131 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.990091 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.989723 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.991302 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.991273 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.991399 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.991302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-config-out\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.991399 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.991286 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.991399 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.991369 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-web-config\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.991563 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.991432 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.991563 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.991442 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.991667 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.991654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.992486 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.992465 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.993097 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.993082 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-config-volume\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:30.998192 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:30.998177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxjr\" (UniqueName: \"kubernetes.io/projected/3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf-kube-api-access-mfxjr\") pod \"alertmanager-main-0\" (UID: \"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:31.044397 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:31.044351 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 15:23:31.187605 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:31.187573 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 15:23:31.190451 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:23:31.190421 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3046e6a7_e53c_4e70_b9e0_ae5c9dd229bf.slice/crio-26169c9db24dbd41fa12a00a8e25ef5fa257490991018b74ba53b4926893a9bd WatchSource:0}: Error finding container 26169c9db24dbd41fa12a00a8e25ef5fa257490991018b74ba53b4926893a9bd: Status 404 returned error can't find the container with id 26169c9db24dbd41fa12a00a8e25ef5fa257490991018b74ba53b4926893a9bd Jun 11 15:23:31.439821 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:31.439713 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="694f0763-a1e2-4022-b356-a09a0e6f1be4" path="/var/lib/kubelet/pods/694f0763-a1e2-4022-b356-a09a0e6f1be4/volumes" Jun 11 15:23:31.668631 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:31.668595 2574 generic.go:356] "Generic (PLEG): container finished" podID="3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf" containerID="af8f6f14872470d7c2c86eed24821e6537237c9590be7f286c26e50cfa7705bc" exitCode=0 Jun 11 15:23:31.668797 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:31.668680 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf","Type":"ContainerDied","Data":"af8f6f14872470d7c2c86eed24821e6537237c9590be7f286c26e50cfa7705bc"} Jun 11 15:23:31.668797 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:31.668783 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf","Type":"ContainerStarted","Data":"26169c9db24dbd41fa12a00a8e25ef5fa257490991018b74ba53b4926893a9bd"} Jun 11 15:23:32.677060 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:32.677027 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf","Type":"ContainerStarted","Data":"b1d1b70ef22644d6d65e9725d6cd648fde97f59a69427dd13e1985784341dc57"} Jun 11 15:23:32.677444 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:32.677091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf","Type":"ContainerStarted","Data":"2045c3d4b644ec78882c0bde246a0779b55260321c0843478f786b1514d43228"} Jun 11 15:23:32.677444 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:32.677118 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf","Type":"ContainerStarted","Data":"73c504d42e4de165bf818f71934b41eec2623b41d5327438f649868fb7f56695"} Jun 11 15:23:32.677444 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:32.677144 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf","Type":"ContainerStarted","Data":"a6269bc28da38b0fe192603459e966abb10f02b890d9023580d8f588accd5952"} Jun 11 15:23:32.677444 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:32.677168 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf","Type":"ContainerStarted","Data":"6aacbca9070dafaf23f0d6bba8e37e72d400c44cb0ed38fc5d6d3ed12bef17a5"} Jun 11 15:23:32.677444 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:32.677196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf","Type":"ContainerStarted","Data":"986fecd00ef950aab477cdae21fbd2bf8d699880ada57b99834a56cc58b75b44"} Jun 11 15:23:32.708892 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:32.708802 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.691140746 podStartE2EDuration="2.708759958s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.619212ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:23:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:23:32.708018847 +0000 UTC m=+361.724170125" watchObservedRunningTime="2026-06-11 15:23:32.708759958 +0000 UTC m=+361.724911234" Jun 11 15:23:33.449717 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.449680 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:23:33.450121 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.450068 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy" containerID="cri-o://f95dd6459dd081aee56d8ac916886f0e77b5cb342a5e141ab083790aa825bf35" gracePeriod=600 Jun 11 15:23:33.450121 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.450115 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy-web" containerID="cri-o://30abf23af07411a6312c872e46c55479b786f2a757616fa35c0240a7756e46ea" gracePeriod=600 Jun 11 15:23:33.450296 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.450193 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="config-reloader" containerID="cri-o://1a33612035de92fea081ed5b787f372e2d0bf6d10c1a5abd4d89c08334c23251" gracePeriod=600 Jun 11 15:23:33.450296 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.450064 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="prometheus" containerID="cri-o://967520fdb41eda9527bcd4b2f53a33523c832000bf81546842083f8d10373531" gracePeriod=600 Jun 11 15:23:33.450296 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.450083 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="thanos-sidecar" containerID="cri-o://9cd07c5bf27d37a6ffc60e8a137ef24f8292013baf3f188b0d72c525f8928008" gracePeriod=600 Jun 11 15:23:33.450296 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.450292 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://77a2793dfd43310b0ea956c2720ea9316b60f9748000042322a002fda162d5ae" gracePeriod=600 Jun 11 15:23:33.686977 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.686944 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerID="77a2793dfd43310b0ea956c2720ea9316b60f9748000042322a002fda162d5ae" exitCode=0 Jun 11 15:23:33.686977 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.686969 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerID="f95dd6459dd081aee56d8ac916886f0e77b5cb342a5e141ab083790aa825bf35" exitCode=0 Jun 11 15:23:33.686977 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.686975 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerID="9cd07c5bf27d37a6ffc60e8a137ef24f8292013baf3f188b0d72c525f8928008" exitCode=0 Jun 11 15:23:33.686977 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.686981 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerID="1a33612035de92fea081ed5b787f372e2d0bf6d10c1a5abd4d89c08334c23251" exitCode=0 Jun 11 15:23:33.686977 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.686987 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerID="967520fdb41eda9527bcd4b2f53a33523c832000bf81546842083f8d10373531" exitCode=0 Jun 11 15:23:33.687461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.686982 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerDied","Data":"77a2793dfd43310b0ea956c2720ea9316b60f9748000042322a002fda162d5ae"} Jun 11 15:23:33.687461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.687071 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerDied","Data":"f95dd6459dd081aee56d8ac916886f0e77b5cb342a5e141ab083790aa825bf35"} Jun 11 15:23:33.687461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.687119 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerDied","Data":"9cd07c5bf27d37a6ffc60e8a137ef24f8292013baf3f188b0d72c525f8928008"} Jun 11 15:23:33.687461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.687179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerDied","Data":"1a33612035de92fea081ed5b787f372e2d0bf6d10c1a5abd4d89c08334c23251"} Jun 11 15:23:33.687461 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:33.687221 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerDied","Data":"967520fdb41eda9527bcd4b2f53a33523c832000bf81546842083f8d10373531"} Jun 11 15:23:34.697061 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.697031 2574 generic.go:356] "Generic (PLEG): container finished" podID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerID="30abf23af07411a6312c872e46c55479b786f2a757616fa35c0240a7756e46ea" exitCode=0 Jun 11 15:23:34.697405 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.697105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerDied","Data":"30abf23af07411a6312c872e46c55479b786f2a757616fa35c0240a7756e46ea"} Jun 11 15:23:34.697405 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.697213 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5e927953-353e-47d8-9bd2-9ce4b264a1c7","Type":"ContainerDied","Data":"cdbb1ce177132a771a4624b99cd9ed41cf8fe06f3c769f8c68cb2649dd0604e1"} Jun 11 15:23:34.697405 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.697261 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdbb1ce177132a771a4624b99cd9ed41cf8fe06f3c769f8c68cb2649dd0604e1" Jun 11 15:23:34.705257 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.705237 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:34.825204 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825105 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-kube-rbac-proxy\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825204 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825147 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825204 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825176 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-thanos-prometheus-http-client-file\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825204 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825200 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-tls-assets\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825586 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825330 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-trusted-ca-bundle\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825586 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825374 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-tls\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825586 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825411 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825586 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825446 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config-out\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825586 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825469 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-2\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825586 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825518 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-0\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825586 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825557 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-1\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.825586 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825580 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-db\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825608 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-web-config\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825655 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-metrics-client-certs\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825679 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-metrics-client-ca\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825722 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825746 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-serving-certs-ca-bundle\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825743 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825803 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-grpc-tls\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825831 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm6jn\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-kube-api-access-vm6jn\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.825906 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-kubelet-serving-ca-bundle\") pod \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\" (UID: \"5e927953-353e-47d8-9bd2-9ce4b264a1c7\") " Jun 11 15:23:34.826049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.826031 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:34.826541 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.826251 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.827393 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.827367 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:34.827499 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.827476 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:34.827858 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.827830 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:34.828144 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.828106 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:34.828493 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.828460 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:23:34.828819 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.828764 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:23:34.828918 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.828880 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.829981 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.829950 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.830081 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.829997 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.830081 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.830071 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.830419 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.830375 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config" (OuterVolumeSpecName: "config") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.830419 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.830389 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:23:34.830540 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.830438 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-kube-api-access-vm6jn" (OuterVolumeSpecName: "kube-api-access-vm6jn") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "kube-api-access-vm6jn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:23:34.830750 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.830726 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.830896 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.830876 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.831014 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.830993 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.831534 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.831520 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config-out" (OuterVolumeSpecName: "config-out") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:23:34.841133 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.841106 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-web-config" (OuterVolumeSpecName: "web-config") pod "5e927953-353e-47d8-9bd2-9ce4b264a1c7" (UID: "5e927953-353e-47d8-9bd2-9ce4b264a1c7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:23:34.927203 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927165 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927203 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927195 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-tls-assets\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927203 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927205 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927203 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927214 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927223 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config-out\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927232 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927240 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927249 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927257 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5e927953-353e-47d8-9bd2-9ce4b264a1c7-prometheus-k8s-db\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927265 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-web-config\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927277 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-metrics-client-certs\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927285 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-metrics-client-ca\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927293 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927303 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927310 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-grpc-tls\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927318 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm6jn\" (UniqueName: \"kubernetes.io/projected/5e927953-353e-47d8-9bd2-9ce4b264a1c7-kube-api-access-vm6jn\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927326 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e927953-353e-47d8-9bd2-9ce4b264a1c7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927336 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-secret-kube-rbac-proxy\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:34.927457 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:34.927344 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5e927953-353e-47d8-9bd2-9ce4b264a1c7-config\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:23:35.700668 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.700588 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.724561 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.724526 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:23:35.729620 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.729592 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:23:35.758234 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758203 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:23:35.758521 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758506 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy" Jun 11 15:23:35.758521 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758521 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758531 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="config-reloader" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758536 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="config-reloader" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758544 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="init-config-reloader" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758550 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="init-config-reloader" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758556 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy-thanos" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758561 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy-thanos" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758571 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="prometheus" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758576 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="prometheus" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758594 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="thanos-sidecar" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758599 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="thanos-sidecar" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758605 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy-web" Jun 11 15:23:35.758625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758610 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy-web" Jun 11 15:23:35.758985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758653 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy" Jun 11 15:23:35.758985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758663 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy-web" Jun 11 15:23:35.758985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758670 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="prometheus" Jun 11 15:23:35.758985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758675 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="thanos-sidecar" Jun 11 15:23:35.758985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758680 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="config-reloader" Jun 11 15:23:35.758985 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.758686 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" containerName="kube-rbac-proxy-thanos" Jun 11 15:23:35.763500 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.763479 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.766269 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.766244 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 15:23:35.766375 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.766290 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 15:23:35.766425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.766410 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 15:23:35.767757 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.767739 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 15:23:35.767939 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.767922 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 15:23:35.767939 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.767935 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 15:23:35.768106 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.767965 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 15:23:35.768106 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.768019 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 15:23:35.768218 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.768141 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 15:23:35.768372 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.768347 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 15:23:35.768444 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.768395 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3jsspjddjeadv\"" Jun 11 15:23:35.768444 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.768433 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 15:23:35.768669 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.768656 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 15:23:35.769493 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.769476 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-66d5t\"" Jun 11 15:23:35.773265 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.772896 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 15:23:35.775616 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.775597 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 15:23:35.814351 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.814320 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:23:35.934600 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.934600 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.934855 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.934855 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.934855 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.934855 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.934855 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75517f1-a9cc-498f-800b-d73d1d2bcde4-config-out\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.934855 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934835 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935023 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935023 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-web-config\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935023 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934935 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935023 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.934955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75517f1-a9cc-498f-800b-d73d1d2bcde4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935023 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.935002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-config\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935023 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.935019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935190 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.935036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935190 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.935054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935190 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.935076 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlzfn\" (UniqueName: \"kubernetes.io/projected/f75517f1-a9cc-498f-800b-d73d1d2bcde4-kube-api-access-vlzfn\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935190 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.935104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935190 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.935123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:35.935190 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:35.935164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.035999 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.035896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.035999 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.035960 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.035999 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.035979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036252 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036252 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036252 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036252 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75517f1-a9cc-498f-800b-d73d1d2bcde4-config-out\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036451 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036431 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-web-config\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75517f1-a9cc-498f-800b-d73d1d2bcde4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036533 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-config\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.036653 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlzfn\" (UniqueName: \"kubernetes.io/projected/f75517f1-a9cc-498f-800b-d73d1d2bcde4-kube-api-access-vlzfn\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.037006 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036688 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.037006 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.037006 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.037006 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.036732 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.037291 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.037259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.037403 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.037380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.037607 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.037585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.039718 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.039395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.040402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.039920 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.040402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.039993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-config\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.040402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.040012 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.040402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.040220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.040402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.040368 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.040943 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.040649 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.040943 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.040695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.041059 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.040940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f75517f1-a9cc-498f-800b-d73d1d2bcde4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.041191 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.041142 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.041363 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.041341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f75517f1-a9cc-498f-800b-d73d1d2bcde4-config-out\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.042241 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.042216 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.042520 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.042498 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f75517f1-a9cc-498f-800b-d73d1d2bcde4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.042713 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.042699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f75517f1-a9cc-498f-800b-d73d1d2bcde4-web-config\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.048947 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.048929 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlzfn\" (UniqueName: \"kubernetes.io/projected/f75517f1-a9cc-498f-800b-d73d1d2bcde4-kube-api-access-vlzfn\") pod \"prometheus-k8s-0\" (UID: \"f75517f1-a9cc-498f-800b-d73d1d2bcde4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.075922 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.075891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:36.433412 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.433383 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 15:23:36.707484 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.707395 2574 generic.go:356] "Generic (PLEG): container finished" podID="f75517f1-a9cc-498f-800b-d73d1d2bcde4" containerID="fb1e65dec73f23b29f29e911a06d42f347a86deae9d2bcadba36001d5eac554a" exitCode=0 Jun 11 15:23:36.707847 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.707479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75517f1-a9cc-498f-800b-d73d1d2bcde4","Type":"ContainerDied","Data":"fb1e65dec73f23b29f29e911a06d42f347a86deae9d2bcadba36001d5eac554a"} Jun 11 15:23:36.707847 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:36.707576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75517f1-a9cc-498f-800b-d73d1d2bcde4","Type":"ContainerStarted","Data":"2f3be1902f15794b5c810fe2b078e2dfc19d2dac332f7c9087d9c49c311d4782"} Jun 11 15:23:37.439195 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:37.439158 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e927953-353e-47d8-9bd2-9ce4b264a1c7" path="/var/lib/kubelet/pods/5e927953-353e-47d8-9bd2-9ce4b264a1c7/volumes" Jun 11 15:23:37.715274 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:37.715183 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75517f1-a9cc-498f-800b-d73d1d2bcde4","Type":"ContainerStarted","Data":"956b61c88de615b17e21eaefaa21388af48fd55b70ce07a209e1ec054fb02447"} Jun 11 15:23:37.715274 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:37.715246 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75517f1-a9cc-498f-800b-d73d1d2bcde4","Type":"ContainerStarted","Data":"d05c513748e25e2b90e18d5bab6d02b5e153ea4d828f06cbf54220279562ec60"} Jun 11 15:23:37.715274 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:37.715273 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75517f1-a9cc-498f-800b-d73d1d2bcde4","Type":"ContainerStarted","Data":"29527a1a9aa5dfaef443250b3f83c1597495f52b554475b186e95b9d673d17a7"} Jun 11 15:23:37.715691 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:37.715297 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75517f1-a9cc-498f-800b-d73d1d2bcde4","Type":"ContainerStarted","Data":"cb4ac29ced8243ba16efc81c46b135c317732be95a94e9c02c37eb76a968a7db"} Jun 11 15:23:37.715691 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:37.715324 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75517f1-a9cc-498f-800b-d73d1d2bcde4","Type":"ContainerStarted","Data":"2e414ed99d36e92ae4ee8b65e87606d3ab5f69cda2cd2728b2f5eadbc0026368"} Jun 11 15:23:37.715691 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:37.715346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f75517f1-a9cc-498f-800b-d73d1d2bcde4","Type":"ContainerStarted","Data":"c62db1da146ee47c2e374afb4761a9b1f0da86a1bd96a69fca51810f1a4de11c"} Jun 11 15:23:37.747988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:37.747915 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.728569151 podStartE2EDuration="2.747891366s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.322215ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:23:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:23:37.747039425 +0000 UTC m=+366.763190712" watchObservedRunningTime="2026-06-11 15:23:37.747891366 +0000 UTC m=+366.764042634" Jun 11 15:23:41.076855 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:41.076815 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:23:45.433293 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:45.433241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:23:45.435908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:45.435879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/053352ba-ba2b-4fa2-ab5c-ef62c4012e35-metrics-certs\") pod \"network-metrics-daemon-58xmz\" (UID: \"053352ba-ba2b-4fa2-ab5c-ef62c4012e35\") " pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:23:45.737753 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:45.737670 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2cmv6\"" Jun 11 15:23:45.745866 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:45.745841 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58xmz" Jun 11 15:23:45.884766 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:45.884741 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58xmz"] Jun 11 15:23:45.887210 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:23:45.887181 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod053352ba_ba2b_4fa2_ab5c_ef62c4012e35.slice/crio-e2f53bb4a5435a35f31bc06c616b4031e88cf1adcd921a08a6ea2d7d67b674e2 WatchSource:0}: Error finding container e2f53bb4a5435a35f31bc06c616b4031e88cf1adcd921a08a6ea2d7d67b674e2: Status 404 returned error can't find the container with id e2f53bb4a5435a35f31bc06c616b4031e88cf1adcd921a08a6ea2d7d67b674e2 Jun 11 15:23:45.889322 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:45.889302 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:23:46.756884 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:46.756807 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58xmz" event={"ID":"053352ba-ba2b-4fa2-ab5c-ef62c4012e35","Type":"ContainerStarted","Data":"e2f53bb4a5435a35f31bc06c616b4031e88cf1adcd921a08a6ea2d7d67b674e2"} Jun 11 15:23:47.764193 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:47.764154 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58xmz" event={"ID":"053352ba-ba2b-4fa2-ab5c-ef62c4012e35","Type":"ContainerStarted","Data":"d07714b579e493238e6feee538f1c83d4b60ef2591414360033dd4758d3d2888"} Jun 11 15:23:47.764602 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:47.764216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58xmz" event={"ID":"053352ba-ba2b-4fa2-ab5c-ef62c4012e35","Type":"ContainerStarted","Data":"ba71115a9d6a56cc7fb42a1709308cb74b3db9d30fbfadf7c7a08f6351007706"} Jun 11 15:23:47.785070 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:23:47.785020 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-58xmz" podStartSLOduration=375.964631452 podStartE2EDuration="6m16.785004021s" totalImagesPullingTime="820.372569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:17:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:23:47.784594397 +0000 UTC m=+376.800745673" watchObservedRunningTime="2026-06-11 15:23:47.785004021 +0000 UTC m=+376.801155295" Jun 11 15:24:36.076955 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:24:36.076912 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:24:36.092608 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:24:36.092583 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:24:36.981869 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:24:36.981844 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 15:26:38.516140 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.516104 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c548d559f-58skz"] Jun 11 15:26:38.519275 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.519259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.523723 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.523704 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 15:26:38.523883 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.523728 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 15:26:38.524636 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.524615 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 15:26:38.524827 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.524810 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fx5k4\"" Jun 11 15:26:38.525140 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.524844 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 15:26:38.525245 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.524704 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 15:26:38.533585 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.533564 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c548d559f-58skz"] Jun 11 15:26:38.635221 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.635187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1734a38a-8746-4c3f-86f4-c06a6366a610-metrics-cert\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.635221 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.635225 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1734a38a-8746-4c3f-86f4-c06a6366a610-cert\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.635456 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.635286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1734a38a-8746-4c3f-86f4-c06a6366a610-manager-config\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.635456 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.635309 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9z9f\" (UniqueName: \"kubernetes.io/projected/1734a38a-8746-4c3f-86f4-c06a6366a610-kube-api-access-g9z9f\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.736723 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.736684 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1734a38a-8746-4c3f-86f4-c06a6366a610-metrics-cert\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.736723 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.736724 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1734a38a-8746-4c3f-86f4-c06a6366a610-cert\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.737001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.736765 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1734a38a-8746-4c3f-86f4-c06a6366a610-manager-config\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.737001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.736809 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9z9f\" (UniqueName: \"kubernetes.io/projected/1734a38a-8746-4c3f-86f4-c06a6366a610-kube-api-access-g9z9f\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.737452 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.737429 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1734a38a-8746-4c3f-86f4-c06a6366a610-manager-config\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.739186 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.739168 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1734a38a-8746-4c3f-86f4-c06a6366a610-metrics-cert\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.739301 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.739283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1734a38a-8746-4c3f-86f4-c06a6366a610-cert\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.750314 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.750288 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9z9f\" (UniqueName: \"kubernetes.io/projected/1734a38a-8746-4c3f-86f4-c06a6366a610-kube-api-access-g9z9f\") pod \"lws-controller-manager-7c548d559f-58skz\" (UID: \"1734a38a-8746-4c3f-86f4-c06a6366a610\") " pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.829603 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.829517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:38.994462 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:38.994426 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c548d559f-58skz"] Jun 11 15:26:38.997671 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:26:38.997647 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1734a38a_8746_4c3f_86f4_c06a6366a610.slice/crio-30c1f7de3468d8b15567283d0fb45cb15a616e02e48357891a17a1aece2925d6 WatchSource:0}: Error finding container 30c1f7de3468d8b15567283d0fb45cb15a616e02e48357891a17a1aece2925d6: Status 404 returned error can't find the container with id 30c1f7de3468d8b15567283d0fb45cb15a616e02e48357891a17a1aece2925d6 Jun 11 15:26:39.474460 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:39.474424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" event={"ID":"1734a38a-8746-4c3f-86f4-c06a6366a610","Type":"ContainerStarted","Data":"30c1f7de3468d8b15567283d0fb45cb15a616e02e48357891a17a1aece2925d6"} Jun 11 15:26:40.663459 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.663428 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz"] Jun 11 15:26:40.666734 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.666716 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.673946 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.673906 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 15:26:40.674178 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.674160 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 15:26:40.674354 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.674331 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pgv5s\"" Jun 11 15:26:40.674463 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.674392 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 15:26:40.674463 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.674435 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 15:26:40.680590 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.680570 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz"] Jun 11 15:26:40.759267 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.759237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/981f6726-b941-49b0-87d1-717a87b8546b-tmp\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.759432 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.759280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/981f6726-b941-49b0-87d1-717a87b8546b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.759432 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.759313 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/981f6726-b941-49b0-87d1-717a87b8546b-manifests\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.759432 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.759340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/981f6726-b941-49b0-87d1-717a87b8546b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.759432 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.759380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjpvf\" (UniqueName: \"kubernetes.io/projected/981f6726-b941-49b0-87d1-717a87b8546b-kube-api-access-cjpvf\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.859975 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.859939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/981f6726-b941-49b0-87d1-717a87b8546b-manifests\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.859975 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.859983 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/981f6726-b941-49b0-87d1-717a87b8546b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.860238 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.860108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjpvf\" (UniqueName: \"kubernetes.io/projected/981f6726-b941-49b0-87d1-717a87b8546b-kube-api-access-cjpvf\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.860238 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.860158 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/981f6726-b941-49b0-87d1-717a87b8546b-tmp\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.860238 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.860200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/981f6726-b941-49b0-87d1-717a87b8546b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.860447 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.860426 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/981f6726-b941-49b0-87d1-717a87b8546b-manifests\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.862515 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.862481 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/981f6726-b941-49b0-87d1-717a87b8546b-tmp\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.862668 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.862652 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/981f6726-b941-49b0-87d1-717a87b8546b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.862730 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.862676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/981f6726-b941-49b0-87d1-717a87b8546b-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.871507 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.871485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjpvf\" (UniqueName: \"kubernetes.io/projected/981f6726-b941-49b0-87d1-717a87b8546b-kube-api-access-cjpvf\") pod \"opendatahub-operator-controller-manager-7bf4ff8955-6p9lz\" (UID: \"981f6726-b941-49b0-87d1-717a87b8546b\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:40.977243 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:40.977201 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:41.115912 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:41.115888 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz"] Jun 11 15:26:41.118629 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:26:41.118604 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod981f6726_b941_49b0_87d1_717a87b8546b.slice/crio-844d2859bb07520a99fd830bcc4b74b9f929ca4e5002ab190ba3b713b88c5b43 WatchSource:0}: Error finding container 844d2859bb07520a99fd830bcc4b74b9f929ca4e5002ab190ba3b713b88c5b43: Status 404 returned error can't find the container with id 844d2859bb07520a99fd830bcc4b74b9f929ca4e5002ab190ba3b713b88c5b43 Jun 11 15:26:41.485852 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:41.485815 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" event={"ID":"981f6726-b941-49b0-87d1-717a87b8546b","Type":"ContainerStarted","Data":"844d2859bb07520a99fd830bcc4b74b9f929ca4e5002ab190ba3b713b88c5b43"} Jun 11 15:26:45.510780 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:45.510743 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" event={"ID":"981f6726-b941-49b0-87d1-717a87b8546b","Type":"ContainerStarted","Data":"fd17a90687f1795adaba84fc8b6f8f3f1da6d3b7302823fbea96d1bd5899eb9b"} Jun 11 15:26:45.512072 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:45.512048 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" event={"ID":"1734a38a-8746-4c3f-86f4-c06a6366a610","Type":"ContainerStarted","Data":"f1a40b319ffa3bde4f152e3db06da14497673ba91e70c4e242ba7bf7a08819d7"} Jun 11 15:26:45.512188 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:45.512155 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:45.552452 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:45.552411 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" podStartSLOduration=2.011225352 podStartE2EDuration="7.552396691s" totalImagesPullingTime="5.541171339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:26:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:26:45.551000094 +0000 UTC m=+554.567151370" watchObservedRunningTime="2026-06-11 15:26:45.552396691 +0000 UTC m=+554.568547966" Jun 11 15:26:46.517619 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:46.517585 2574 generic.go:356] "Generic (PLEG): container finished" podID="981f6726-b941-49b0-87d1-717a87b8546b" containerID="fd17a90687f1795adaba84fc8b6f8f3f1da6d3b7302823fbea96d1bd5899eb9b" exitCode=0 Jun 11 15:26:46.518105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:46.517680 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" event={"ID":"981f6726-b941-49b0-87d1-717a87b8546b","Type":"ContainerDied","Data":"fd17a90687f1795adaba84fc8b6f8f3f1da6d3b7302823fbea96d1bd5899eb9b"} Jun 11 15:26:47.523488 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:47.523452 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" event={"ID":"981f6726-b941-49b0-87d1-717a87b8546b","Type":"ContainerStarted","Data":"a5cb90be9fc9ae8c3f4e59b2f7bd9d6f813d269f0cde9a454866e32f57e58369"} Jun 11 15:26:47.523923 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:47.523538 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:26:47.552288 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:47.552241 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" podStartSLOduration=2.798541227 podStartE2EDuration="7.552226291s" totalImagesPullingTime="3.814865983s" totalInitContainerRuntime="938.819081ms" isStatefulPod=false podCreationTimestamp="2026-06-11 15:26:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:26:47.55122903 +0000 UTC m=+556.567380304" watchObservedRunningTime="2026-06-11 15:26:47.552226291 +0000 UTC m=+556.568377566" Jun 11 15:26:56.519701 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:56.519668 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c548d559f-58skz" Jun 11 15:26:58.530337 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:26:58.530306 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bf4ff8955-6p9lz" Jun 11 15:27:01.273218 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.273184 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45"] Jun 11 15:27:01.359902 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.359872 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45"] Jun 11 15:27:01.360049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.359964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.362273 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.362251 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 15:27:01.362879 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.362857 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 15:27:01.362879 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.362877 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9s778\"" Jun 11 15:27:01.449883 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.449854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae6e2663-e58d-4b2e-ac51-e88269320d29-tls-certs\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.450093 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.449904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae6e2663-e58d-4b2e-ac51-e88269320d29-tmp\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.450093 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.449999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8pk6\" (UniqueName: \"kubernetes.io/projected/ae6e2663-e58d-4b2e-ac51-e88269320d29-kube-api-access-l8pk6\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.550658 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.550567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae6e2663-e58d-4b2e-ac51-e88269320d29-tls-certs\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.550658 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.550631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae6e2663-e58d-4b2e-ac51-e88269320d29-tmp\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.550899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.550670 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8pk6\" (UniqueName: \"kubernetes.io/projected/ae6e2663-e58d-4b2e-ac51-e88269320d29-kube-api-access-l8pk6\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.553152 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.553120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae6e2663-e58d-4b2e-ac51-e88269320d29-tmp\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.553340 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.553308 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae6e2663-e58d-4b2e-ac51-e88269320d29-tls-certs\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.560273 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.560248 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8pk6\" (UniqueName: \"kubernetes.io/projected/ae6e2663-e58d-4b2e-ac51-e88269320d29-kube-api-access-l8pk6\") pod \"kube-auth-proxy-66fd5b6ff9-9ss45\" (UID: \"ae6e2663-e58d-4b2e-ac51-e88269320d29\") " pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.669187 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.669143 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" Jun 11 15:27:01.822157 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:01.822131 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45"] Jun 11 15:27:01.824784 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:27:01.824746 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6e2663_e58d_4b2e_ac51_e88269320d29.slice/crio-0ab310baff2860657ea6955f9efe42ee4219f14074fc06a7ba221e6082b77240 WatchSource:0}: Error finding container 0ab310baff2860657ea6955f9efe42ee4219f14074fc06a7ba221e6082b77240: Status 404 returned error can't find the container with id 0ab310baff2860657ea6955f9efe42ee4219f14074fc06a7ba221e6082b77240 Jun 11 15:27:02.595348 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:02.595307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" event={"ID":"ae6e2663-e58d-4b2e-ac51-e88269320d29","Type":"ContainerStarted","Data":"0ab310baff2860657ea6955f9efe42ee4219f14074fc06a7ba221e6082b77240"} Jun 11 15:27:04.607115 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:04.607080 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" event={"ID":"ae6e2663-e58d-4b2e-ac51-e88269320d29","Type":"ContainerStarted","Data":"58089b15c932d60431a8ea5a4ecb950db9e2792c6682331dc04fc85f9d0e5549"} Jun 11 15:27:04.626263 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:04.626215 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-66fd5b6ff9-9ss45" podStartSLOduration=1.060470278 podStartE2EDuration="3.626199722s" totalImagesPullingTime="2.565729444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:27:04.625078336 +0000 UTC m=+573.641229611" watchObservedRunningTime="2026-06-11 15:27:04.626199722 +0000 UTC m=+573.642350997" Jun 11 15:27:31.434935 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:31.434903 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:27:31.435470 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:27:31.435008 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:28:31.432144 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:31.432113 2574 scope.go:117] "RemoveContainer" containerID="77a2793dfd43310b0ea956c2720ea9316b60f9748000042322a002fda162d5ae" Jun 11 15:28:31.440688 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:31.440668 2574 scope.go:117] "RemoveContainer" containerID="f95dd6459dd081aee56d8ac916886f0e77b5cb342a5e141ab083790aa825bf35" Jun 11 15:28:31.448055 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:31.448036 2574 scope.go:117] "RemoveContainer" containerID="30abf23af07411a6312c872e46c55479b786f2a757616fa35c0240a7756e46ea" Jun 11 15:28:31.454561 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:31.454544 2574 scope.go:117] "RemoveContainer" containerID="1a33612035de92fea081ed5b787f372e2d0bf6d10c1a5abd4d89c08334c23251" Jun 11 15:28:31.461132 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:31.461114 2574 scope.go:117] "RemoveContainer" containerID="967520fdb41eda9527bcd4b2f53a33523c832000bf81546842083f8d10373531" Jun 11 15:28:31.467959 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:31.467942 2574 scope.go:117] "RemoveContainer" containerID="9c83ae5572dc9a2d7efd663d41e81f15e7fd4567206a163988e8f4af30757a4a" Jun 11 15:28:31.474616 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:31.474596 2574 scope.go:117] "RemoveContainer" containerID="9cd07c5bf27d37a6ffc60e8a137ef24f8292013baf3f188b0d72c525f8928008" Jun 11 15:28:40.027311 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.027271 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s"] Jun 11 15:28:40.032276 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.032260 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:40.036430 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.036409 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rx64l\"" Jun 11 15:28:40.040600 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.040585 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 15:28:40.043800 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.043763 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 15:28:40.047935 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.047915 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s"] Jun 11 15:28:40.133624 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.133593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" (UID: \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:40.133810 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.133633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76r4n\" (UniqueName: \"kubernetes.io/projected/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-kube-api-access-76r4n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" (UID: \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:40.234959 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.234917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76r4n\" (UniqueName: \"kubernetes.io/projected/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-kube-api-access-76r4n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" (UID: \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:40.235113 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.235088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" (UID: \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:40.235425 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.235406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" (UID: \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:40.246727 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.246702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76r4n\" (UniqueName: \"kubernetes.io/projected/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-kube-api-access-76r4n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" (UID: \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:40.343247 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.343169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:40.475903 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:40.475882 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s"] Jun 11 15:28:40.478463 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:28:40.478430 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44b4751_5a46_444f_ab50_d3e6b85f8b4f.slice/crio-8f1a4c2ffb740913ba539cfae08fa860316b40e698cc14bf8dcc3d70102fedfd WatchSource:0}: Error finding container 8f1a4c2ffb740913ba539cfae08fa860316b40e698cc14bf8dcc3d70102fedfd: Status 404 returned error can't find the container with id 8f1a4c2ffb740913ba539cfae08fa860316b40e698cc14bf8dcc3d70102fedfd Jun 11 15:28:41.047247 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:41.047213 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" event={"ID":"d44b4751-5a46-444f-ab50-d3e6b85f8b4f","Type":"ContainerStarted","Data":"8f1a4c2ffb740913ba539cfae08fa860316b40e698cc14bf8dcc3d70102fedfd"} Jun 11 15:28:48.081101 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:48.081062 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" event={"ID":"d44b4751-5a46-444f-ab50-d3e6b85f8b4f","Type":"ContainerStarted","Data":"6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26"} Jun 11 15:28:48.081535 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:48.081196 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:28:48.102125 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:48.102076 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" podStartSLOduration=1.674816611 podStartE2EDuration="9.102062677s" totalImagesPullingTime="7.427246066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:28:48.10098892 +0000 UTC m=+677.117140193" watchObservedRunningTime="2026-06-11 15:28:48.102062677 +0000 UTC m=+677.118213953" Jun 11 15:28:59.088899 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:28:59.088868 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:00.800670 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.800633 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s"] Jun 11 15:29:00.801165 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.800873 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" containerName="manager" containerID="cri-o://6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26" gracePeriod=2 Jun 11 15:29:00.819373 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.819315 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s"] Jun 11 15:29:00.825381 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.825347 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc"] Jun 11 15:29:00.825866 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.825845 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" containerName="manager" Jun 11 15:29:00.825866 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.825867 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" containerName="manager" Jun 11 15:29:00.826019 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.825982 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" containerName="manager" Jun 11 15:29:00.828954 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.828924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:00.832107 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:29:00.832078 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\": pods \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:00.834145 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:29:00.834119 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" is forbidden: User \"system:node:ip-10-0-142-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-103.ec2.internal' and this object" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:00.848939 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.848918 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc"] Jun 11 15:29:00.926483 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.926451 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbs4\" (UniqueName: \"kubernetes.io/projected/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-kube-api-access-mgbs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rfhkc\" (UID: \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:00.926607 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:00.926563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rfhkc\" (UID: \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:01.027988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.027956 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbs4\" (UniqueName: \"kubernetes.io/projected/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-kube-api-access-mgbs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rfhkc\" (UID: \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:01.028109 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.028018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rfhkc\" (UID: \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:01.028335 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.028318 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rfhkc\" (UID: \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:01.038320 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.038290 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:01.038704 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.038683 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbs4\" (UniqueName: \"kubernetes.io/projected/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-kube-api-access-mgbs4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rfhkc\" (UID: \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:01.040304 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:29:01.040284 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" is forbidden: User \"system:node:ip-10-0-142-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-103.ec2.internal' and this object" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:01.128839 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.128766 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-extensions-socket-volume\") pod \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\" (UID: \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\") " Jun 11 15:29:01.128839 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.128808 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76r4n\" (UniqueName: \"kubernetes.io/projected/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-kube-api-access-76r4n\") pod \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\" (UID: \"d44b4751-5a46-444f-ab50-d3e6b85f8b4f\") " Jun 11 15:29:01.129252 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.129233 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d44b4751-5a46-444f-ab50-d3e6b85f8b4f" (UID: "d44b4751-5a46-444f-ab50-d3e6b85f8b4f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:29:01.130739 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.130714 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-kube-api-access-76r4n" (OuterVolumeSpecName: "kube-api-access-76r4n") pod "d44b4751-5a46-444f-ab50-d3e6b85f8b4f" (UID: "d44b4751-5a46-444f-ab50-d3e6b85f8b4f"). InnerVolumeSpecName "kube-api-access-76r4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:29:01.140671 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.140648 2574 generic.go:356] "Generic (PLEG): container finished" podID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" containerID="6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26" exitCode=0 Jun 11 15:29:01.140751 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.140691 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:01.140751 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.140696 2574 scope.go:117] "RemoveContainer" containerID="6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26" Jun 11 15:29:01.143080 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:29:01.143057 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" is forbidden: User \"system:node:ip-10-0-142-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-103.ec2.internal' and this object" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:01.148725 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.148709 2574 scope.go:117] "RemoveContainer" containerID="6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26" Jun 11 15:29:01.149009 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:29:01.148992 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26\": container with ID starting with 6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26 not found: ID does not exist" containerID="6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26" Jun 11 15:29:01.149054 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.149017 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26"} err="failed to get container status \"6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26\": rpc error: code = NotFound desc = could not find container \"6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26\": container with ID starting with 6dd69ac60230efeaa40fe960fc34cb94c0d94e73945607f3db6fa912d83f2e26 not found: ID does not exist" Jun 11 15:29:01.150752 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:29:01.150731 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" is forbidden: User \"system:node:ip-10-0-142-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-103.ec2.internal' and this object" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:01.178454 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.178428 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:01.230412 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.230380 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-extensions-socket-volume\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:29:01.230507 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.230418 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76r4n\" (UniqueName: \"kubernetes.io/projected/d44b4751-5a46-444f-ab50-d3e6b85f8b4f-kube-api-access-76r4n\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:29:01.309674 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.309648 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc"] Jun 11 15:29:01.311794 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:29:01.311750 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67394c4e_dd9d_46f1_b0e9_3ec9c0898940.slice/crio-5d2fece79325c5d89c97ba0aa438e83ac581ddc621ee72dd8666d9fe21e7b991 WatchSource:0}: Error finding container 5d2fece79325c5d89c97ba0aa438e83ac581ddc621ee72dd8666d9fe21e7b991: Status 404 returned error can't find the container with id 5d2fece79325c5d89c97ba0aa438e83ac581ddc621ee72dd8666d9fe21e7b991 Jun 11 15:29:01.437801 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:29:01.437746 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-mtp5s\" is forbidden: User \"system:node:ip-10-0-142-103.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-103.ec2.internal' and this object" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mtp5s" Jun 11 15:29:01.439697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:01.439671 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d44b4751-5a46-444f-ab50-d3e6b85f8b4f" path="/var/lib/kubelet/pods/d44b4751-5a46-444f-ab50-d3e6b85f8b4f/volumes" Jun 11 15:29:02.147062 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:02.147023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" event={"ID":"67394c4e-dd9d-46f1-b0e9-3ec9c0898940","Type":"ContainerStarted","Data":"f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825"} Jun 11 15:29:02.147517 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:02.147089 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" event={"ID":"67394c4e-dd9d-46f1-b0e9-3ec9c0898940","Type":"ContainerStarted","Data":"5d2fece79325c5d89c97ba0aa438e83ac581ddc621ee72dd8666d9fe21e7b991"} Jun 11 15:29:02.147517 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:02.147116 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:02.166504 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:02.166454 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" podStartSLOduration=2.166437205 podStartE2EDuration="2.166437205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:02.165651979 +0000 UTC m=+691.181803266" watchObservedRunningTime="2026-06-11 15:29:02.166437205 +0000 UTC m=+691.182588484" Jun 11 15:29:13.154751 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:13.154717 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:18.194036 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.193991 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc"] Jun 11 15:29:18.194387 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.194189 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" podUID="67394c4e-dd9d-46f1-b0e9-3ec9c0898940" containerName="manager" containerID="cri-o://f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825" gracePeriod=10 Jun 11 15:29:18.439537 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.439514 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:18.483914 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.483847 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl"] Jun 11 15:29:18.484362 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.484344 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67394c4e-dd9d-46f1-b0e9-3ec9c0898940" containerName="manager" Jun 11 15:29:18.484402 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.484367 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="67394c4e-dd9d-46f1-b0e9-3ec9c0898940" containerName="manager" Jun 11 15:29:18.484504 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.484492 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="67394c4e-dd9d-46f1-b0e9-3ec9c0898940" containerName="manager" Jun 11 15:29:18.487694 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.487676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:18.498426 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.498406 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl"] Jun 11 15:29:18.582359 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.582335 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-extensions-socket-volume\") pod \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\" (UID: \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\") " Jun 11 15:29:18.582506 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.582417 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgbs4\" (UniqueName: \"kubernetes.io/projected/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-kube-api-access-mgbs4\") pod \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\" (UID: \"67394c4e-dd9d-46f1-b0e9-3ec9c0898940\") " Jun 11 15:29:18.583100 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.582638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tnxp\" (UniqueName: \"kubernetes.io/projected/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-kube-api-access-4tnxp\") pod \"kuadrant-operator-controller-manager-86878c769f-84fxl\" (UID: \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:18.583100 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.582669 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "67394c4e-dd9d-46f1-b0e9-3ec9c0898940" (UID: "67394c4e-dd9d-46f1-b0e9-3ec9c0898940"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:29:18.583100 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.582688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-84fxl\" (UID: \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:18.583100 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.582881 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-extensions-socket-volume\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:29:18.584332 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.584313 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-kube-api-access-mgbs4" (OuterVolumeSpecName: "kube-api-access-mgbs4") pod "67394c4e-dd9d-46f1-b0e9-3ec9c0898940" (UID: "67394c4e-dd9d-46f1-b0e9-3ec9c0898940"). InnerVolumeSpecName "kube-api-access-mgbs4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:29:18.683742 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.683716 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tnxp\" (UniqueName: \"kubernetes.io/projected/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-kube-api-access-4tnxp\") pod \"kuadrant-operator-controller-manager-86878c769f-84fxl\" (UID: \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:18.683863 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.683752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-84fxl\" (UID: \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:18.683863 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.683805 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgbs4\" (UniqueName: \"kubernetes.io/projected/67394c4e-dd9d-46f1-b0e9-3ec9c0898940-kube-api-access-mgbs4\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:29:18.684185 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.684169 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-84fxl\" (UID: \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:18.696376 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.693965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tnxp\" (UniqueName: \"kubernetes.io/projected/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-kube-api-access-4tnxp\") pod \"kuadrant-operator-controller-manager-86878c769f-84fxl\" (UID: \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:18.797988 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.797934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:18.926500 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:18.926478 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl"] Jun 11 15:29:18.929483 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:29:18.929459 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf8420bd_7e7d_4ee6_ba78_5729b10a85d1.slice/crio-fe0a4db632700d31358a06057b4ea16f733052c68fc377e04fb9c071a25ae2b9 WatchSource:0}: Error finding container fe0a4db632700d31358a06057b4ea16f733052c68fc377e04fb9c071a25ae2b9: Status 404 returned error can't find the container with id fe0a4db632700d31358a06057b4ea16f733052c68fc377e04fb9c071a25ae2b9 Jun 11 15:29:19.228314 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.228276 2574 generic.go:356] "Generic (PLEG): container finished" podID="67394c4e-dd9d-46f1-b0e9-3ec9c0898940" containerID="f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825" exitCode=0 Jun 11 15:29:19.228705 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.228319 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" event={"ID":"67394c4e-dd9d-46f1-b0e9-3ec9c0898940","Type":"ContainerDied","Data":"f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825"} Jun 11 15:29:19.228705 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.228340 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" Jun 11 15:29:19.228705 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.228373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc" event={"ID":"67394c4e-dd9d-46f1-b0e9-3ec9c0898940","Type":"ContainerDied","Data":"5d2fece79325c5d89c97ba0aa438e83ac581ddc621ee72dd8666d9fe21e7b991"} Jun 11 15:29:19.228705 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.228395 2574 scope.go:117] "RemoveContainer" containerID="f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825" Jun 11 15:29:19.230265 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.230239 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" event={"ID":"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1","Type":"ContainerStarted","Data":"291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2"} Jun 11 15:29:19.230389 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.230295 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:19.230389 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.230323 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" event={"ID":"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1","Type":"ContainerStarted","Data":"fe0a4db632700d31358a06057b4ea16f733052c68fc377e04fb9c071a25ae2b9"} Jun 11 15:29:19.237822 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.237808 2574 scope.go:117] "RemoveContainer" containerID="f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825" Jun 11 15:29:19.238087 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:29:19.238069 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825\": container with ID starting with f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825 not found: ID does not exist" containerID="f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825" Jun 11 15:29:19.238131 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.238095 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825"} err="failed to get container status \"f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825\": rpc error: code = NotFound desc = could not find container \"f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825\": container with ID starting with f63b1660be1606324b97dd470b8d50370f44983dea1e7cbc2dae9bdcd8c51825 not found: ID does not exist" Jun 11 15:29:19.257590 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.257552 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" podStartSLOduration=1.257540528 podStartE2EDuration="1.257540528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:29:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:19.257169028 +0000 UTC m=+708.273320304" watchObservedRunningTime="2026-06-11 15:29:19.257540528 +0000 UTC m=+708.273691803" Jun 11 15:29:19.273329 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.273304 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc"] Jun 11 15:29:19.281270 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.281245 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rfhkc"] Jun 11 15:29:19.438841 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:19.438809 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67394c4e-dd9d-46f1-b0e9-3ec9c0898940" path="/var/lib/kubelet/pods/67394c4e-dd9d-46f1-b0e9-3ec9c0898940/volumes" Jun 11 15:29:30.238897 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:30.238863 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:29:47.325908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.325869 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:29:47.330972 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.330949 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:47.333348 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.333322 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 15:29:47.333493 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.333397 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8xmzz\"" Jun 11 15:29:47.339513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.339486 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:29:47.373655 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.373618 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:29:47.426810 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.426764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13c6e637-e346-4d57-b635-47251e2fb8cf-config-file\") pod \"limitador-limitador-54d6d988d5-krz2l\" (UID: \"13c6e637-e346-4d57-b635-47251e2fb8cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:47.426998 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.426855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8kvw\" (UniqueName: \"kubernetes.io/projected/13c6e637-e346-4d57-b635-47251e2fb8cf-kube-api-access-h8kvw\") pod \"limitador-limitador-54d6d988d5-krz2l\" (UID: \"13c6e637-e346-4d57-b635-47251e2fb8cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:47.527415 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.527373 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13c6e637-e346-4d57-b635-47251e2fb8cf-config-file\") pod \"limitador-limitador-54d6d988d5-krz2l\" (UID: \"13c6e637-e346-4d57-b635-47251e2fb8cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:47.527619 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.527471 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8kvw\" (UniqueName: \"kubernetes.io/projected/13c6e637-e346-4d57-b635-47251e2fb8cf-kube-api-access-h8kvw\") pod \"limitador-limitador-54d6d988d5-krz2l\" (UID: \"13c6e637-e346-4d57-b635-47251e2fb8cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:47.528105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.528081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/13c6e637-e346-4d57-b635-47251e2fb8cf-config-file\") pod \"limitador-limitador-54d6d988d5-krz2l\" (UID: \"13c6e637-e346-4d57-b635-47251e2fb8cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:47.536468 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.536445 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8kvw\" (UniqueName: \"kubernetes.io/projected/13c6e637-e346-4d57-b635-47251e2fb8cf-kube-api-access-h8kvw\") pod \"limitador-limitador-54d6d988d5-krz2l\" (UID: \"13c6e637-e346-4d57-b635-47251e2fb8cf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:47.642810 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.642696 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:47.787820 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.787783 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:29:47.791926 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:29:47.791902 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c6e637_e346_4d57_b635_47251e2fb8cf.slice/crio-10bd8cbd73203b3fed66b4e6048318e586d89209898bf0946e21ca06ca536f1c WatchSource:0}: Error finding container 10bd8cbd73203b3fed66b4e6048318e586d89209898bf0946e21ca06ca536f1c: Status 404 returned error can't find the container with id 10bd8cbd73203b3fed66b4e6048318e586d89209898bf0946e21ca06ca536f1c Jun 11 15:29:47.793929 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:47.793909 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:29:48.013531 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.013499 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dn67n"] Jun 11 15:29:48.018024 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.018007 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dn67n" Jun 11 15:29:48.020391 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.020369 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wkdgr\"" Jun 11 15:29:48.024903 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.024881 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dn67n"] Jun 11 15:29:48.133216 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.133182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kscv4\" (UniqueName: \"kubernetes.io/projected/a0171f90-570b-4ef0-8309-731aad22c32e-kube-api-access-kscv4\") pod \"authorino-75d556bd77-dn67n\" (UID: \"a0171f90-570b-4ef0-8309-731aad22c32e\") " pod="kuadrant-system/authorino-75d556bd77-dn67n" Jun 11 15:29:48.234336 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.234298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kscv4\" (UniqueName: \"kubernetes.io/projected/a0171f90-570b-4ef0-8309-731aad22c32e-kube-api-access-kscv4\") pod \"authorino-75d556bd77-dn67n\" (UID: \"a0171f90-570b-4ef0-8309-731aad22c32e\") " pod="kuadrant-system/authorino-75d556bd77-dn67n" Jun 11 15:29:48.244612 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.244580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kscv4\" (UniqueName: \"kubernetes.io/projected/a0171f90-570b-4ef0-8309-731aad22c32e-kube-api-access-kscv4\") pod \"authorino-75d556bd77-dn67n\" (UID: \"a0171f90-570b-4ef0-8309-731aad22c32e\") " pod="kuadrant-system/authorino-75d556bd77-dn67n" Jun 11 15:29:48.336887 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.336669 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dn67n" Jun 11 15:29:48.369175 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.369091 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" event={"ID":"13c6e637-e346-4d57-b635-47251e2fb8cf","Type":"ContainerStarted","Data":"10bd8cbd73203b3fed66b4e6048318e586d89209898bf0946e21ca06ca536f1c"} Jun 11 15:29:48.523482 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:48.523449 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dn67n"] Jun 11 15:29:48.524615 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:29:48.524582 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0171f90_570b_4ef0_8309_731aad22c32e.slice/crio-16fe41fe3655f9fd8b956d0cfb09d82cf2ed9b072762a2d46c990b7903be7367 WatchSource:0}: Error finding container 16fe41fe3655f9fd8b956d0cfb09d82cf2ed9b072762a2d46c990b7903be7367: Status 404 returned error can't find the container with id 16fe41fe3655f9fd8b956d0cfb09d82cf2ed9b072762a2d46c990b7903be7367 Jun 11 15:29:49.381379 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:49.381315 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dn67n" event={"ID":"a0171f90-570b-4ef0-8309-731aad22c32e","Type":"ContainerStarted","Data":"16fe41fe3655f9fd8b956d0cfb09d82cf2ed9b072762a2d46c990b7903be7367"} Jun 11 15:29:52.398049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:52.398013 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dn67n" event={"ID":"a0171f90-570b-4ef0-8309-731aad22c32e","Type":"ContainerStarted","Data":"48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956"} Jun 11 15:29:52.399512 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:52.399488 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" event={"ID":"13c6e637-e346-4d57-b635-47251e2fb8cf","Type":"ContainerStarted","Data":"6fcb6c57bea7a49adb4a91d00e6a97b5fbb5c6f65e5b468a9e5711ee05da0384"} Jun 11 15:29:52.399639 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:52.399553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:29:52.414267 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:52.414222 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dn67n" podStartSLOduration=1.744054315 podStartE2EDuration="5.414208063s" totalImagesPullingTime="3.670153748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:52.412983375 +0000 UTC m=+741.429134652" watchObservedRunningTime="2026-06-11 15:29:52.414208063 +0000 UTC m=+741.430359339" Jun 11 15:29:52.435847 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:29:52.435759 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" podStartSLOduration=1.033661702 podStartE2EDuration="5.435738021s" totalImagesPullingTime="4.402076319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:29:52.433574616 +0000 UTC m=+741.449725893" watchObservedRunningTime="2026-06-11 15:29:52.435738021 +0000 UTC m=+741.451889297" Jun 11 15:30:03.405318 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:30:03.405287 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-krz2l" Jun 11 15:31:15.123730 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.123688 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m9fxh"] Jun 11 15:31:15.126078 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.126061 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" Jun 11 15:31:15.136535 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.136512 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m9fxh"] Jun 11 15:31:15.181127 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.181095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfj2l\" (UniqueName: \"kubernetes.io/projected/bd243c81-ddd8-4823-83e6-ed0d12a58a73-kube-api-access-pfj2l\") pod \"authorino-5d4b67c446-m9fxh\" (UID: \"bd243c81-ddd8-4823-83e6-ed0d12a58a73\") " pod="kuadrant-system/authorino-5d4b67c446-m9fxh" Jun 11 15:31:15.282180 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.282141 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfj2l\" (UniqueName: \"kubernetes.io/projected/bd243c81-ddd8-4823-83e6-ed0d12a58a73-kube-api-access-pfj2l\") pod \"authorino-5d4b67c446-m9fxh\" (UID: \"bd243c81-ddd8-4823-83e6-ed0d12a58a73\") " pod="kuadrant-system/authorino-5d4b67c446-m9fxh" Jun 11 15:31:15.293765 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.293735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfj2l\" (UniqueName: \"kubernetes.io/projected/bd243c81-ddd8-4823-83e6-ed0d12a58a73-kube-api-access-pfj2l\") pod \"authorino-5d4b67c446-m9fxh\" (UID: \"bd243c81-ddd8-4823-83e6-ed0d12a58a73\") " pod="kuadrant-system/authorino-5d4b67c446-m9fxh" Jun 11 15:31:15.343948 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.343920 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m9fxh"] Jun 11 15:31:15.344167 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.344155 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" Jun 11 15:31:15.374009 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.373932 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5997cb768f-xnttm"] Jun 11 15:31:15.376559 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.376535 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5997cb768f-xnttm" Jun 11 15:31:15.386162 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.386131 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5997cb768f-xnttm"] Jun 11 15:31:15.481436 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.481354 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m9fxh"] Jun 11 15:31:15.483747 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.483717 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w66tt\" (UniqueName: \"kubernetes.io/projected/1c6fe02e-fe4a-4387-b3b9-4f086ce915f5-kube-api-access-w66tt\") pod \"authorino-5997cb768f-xnttm\" (UID: \"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5\") " pod="kuadrant-system/authorino-5997cb768f-xnttm" Jun 11 15:31:15.483873 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:31:15.483740 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd243c81_ddd8_4823_83e6_ed0d12a58a73.slice/crio-b0e8513b908147bdc80f303d1ff1641b1d12850d3c2312b7bf04eac337041f37 WatchSource:0}: Error finding container b0e8513b908147bdc80f303d1ff1641b1d12850d3c2312b7bf04eac337041f37: Status 404 returned error can't find the container with id b0e8513b908147bdc80f303d1ff1641b1d12850d3c2312b7bf04eac337041f37 Jun 11 15:31:15.584444 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.584415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w66tt\" (UniqueName: \"kubernetes.io/projected/1c6fe02e-fe4a-4387-b3b9-4f086ce915f5-kube-api-access-w66tt\") pod \"authorino-5997cb768f-xnttm\" (UID: \"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5\") " pod="kuadrant-system/authorino-5997cb768f-xnttm" Jun 11 15:31:15.597373 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.597340 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w66tt\" (UniqueName: \"kubernetes.io/projected/1c6fe02e-fe4a-4387-b3b9-4f086ce915f5-kube-api-access-w66tt\") pod \"authorino-5997cb768f-xnttm\" (UID: \"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5\") " pod="kuadrant-system/authorino-5997cb768f-xnttm" Jun 11 15:31:15.634909 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.634822 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5997cb768f-xnttm"] Jun 11 15:31:15.635120 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.635106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5997cb768f-xnttm" Jun 11 15:31:15.666818 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.666786 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c6cfb7585-vszdf"] Jun 11 15:31:15.669286 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.669266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:31:15.671754 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.671728 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 15:31:15.680882 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.680861 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c6cfb7585-vszdf"] Jun 11 15:31:15.768739 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.768711 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5997cb768f-xnttm"] Jun 11 15:31:15.770423 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:31:15.770387 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c6fe02e_fe4a_4387_b3b9_4f086ce915f5.slice/crio-f21a76886d2e572a5d352e9530d237de35565544224255700b12e94061012f06 WatchSource:0}: Error finding container f21a76886d2e572a5d352e9530d237de35565544224255700b12e94061012f06: Status 404 returned error can't find the container with id f21a76886d2e572a5d352e9530d237de35565544224255700b12e94061012f06 Jun 11 15:31:15.785764 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.785709 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5997cb768f-xnttm" event={"ID":"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5","Type":"ContainerStarted","Data":"f21a76886d2e572a5d352e9530d237de35565544224255700b12e94061012f06"} Jun 11 15:31:15.786196 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.786173 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj45l\" (UniqueName: \"kubernetes.io/projected/08fe080d-e78a-4e29-9fcc-771cd85d492e-kube-api-access-xj45l\") pod \"authorino-7c6cfb7585-vszdf\" (UID: \"08fe080d-e78a-4e29-9fcc-771cd85d492e\") " pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:31:15.786266 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.786237 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08fe080d-e78a-4e29-9fcc-771cd85d492e-tls-cert\") pod \"authorino-7c6cfb7585-vszdf\" (UID: \"08fe080d-e78a-4e29-9fcc-771cd85d492e\") " pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:31:15.786826 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.786805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" event={"ID":"bd243c81-ddd8-4823-83e6-ed0d12a58a73","Type":"ContainerStarted","Data":"b0e8513b908147bdc80f303d1ff1641b1d12850d3c2312b7bf04eac337041f37"} Jun 11 15:31:15.886862 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.886807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj45l\" (UniqueName: \"kubernetes.io/projected/08fe080d-e78a-4e29-9fcc-771cd85d492e-kube-api-access-xj45l\") pod \"authorino-7c6cfb7585-vszdf\" (UID: \"08fe080d-e78a-4e29-9fcc-771cd85d492e\") " pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:31:15.886862 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.886854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08fe080d-e78a-4e29-9fcc-771cd85d492e-tls-cert\") pod \"authorino-7c6cfb7585-vszdf\" (UID: \"08fe080d-e78a-4e29-9fcc-771cd85d492e\") " pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:31:15.889159 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.889140 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08fe080d-e78a-4e29-9fcc-771cd85d492e-tls-cert\") pod \"authorino-7c6cfb7585-vszdf\" (UID: \"08fe080d-e78a-4e29-9fcc-771cd85d492e\") " pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:31:15.895521 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.895502 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj45l\" (UniqueName: \"kubernetes.io/projected/08fe080d-e78a-4e29-9fcc-771cd85d492e-kube-api-access-xj45l\") pod \"authorino-7c6cfb7585-vszdf\" (UID: \"08fe080d-e78a-4e29-9fcc-771cd85d492e\") " pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:31:15.980201 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:15.980165 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:31:16.112525 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.112499 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c6cfb7585-vszdf"] Jun 11 15:31:16.115081 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:31:16.115056 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08fe080d_e78a_4e29_9fcc_771cd85d492e.slice/crio-3347f29f0f1bcccec976af36e2572688fa36704848ff3430ed72564ecdf32475 WatchSource:0}: Error finding container 3347f29f0f1bcccec976af36e2572688fa36704848ff3430ed72564ecdf32475: Status 404 returned error can't find the container with id 3347f29f0f1bcccec976af36e2572688fa36704848ff3430ed72564ecdf32475 Jun 11 15:31:16.799608 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.799507 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" event={"ID":"08fe080d-e78a-4e29-9fcc-771cd85d492e","Type":"ContainerStarted","Data":"e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b"} Jun 11 15:31:16.799608 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.799558 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" event={"ID":"08fe080d-e78a-4e29-9fcc-771cd85d492e","Type":"ContainerStarted","Data":"3347f29f0f1bcccec976af36e2572688fa36704848ff3430ed72564ecdf32475"} Jun 11 15:31:16.800877 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.800855 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5997cb768f-xnttm" event={"ID":"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5","Type":"ContainerStarted","Data":"eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8"} Jun 11 15:31:16.800978 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.800924 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5997cb768f-xnttm" podUID="1c6fe02e-fe4a-4387-b3b9-4f086ce915f5" containerName="authorino" containerID="cri-o://eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8" gracePeriod=30 Jun 11 15:31:16.802356 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.802336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" event={"ID":"bd243c81-ddd8-4823-83e6-ed0d12a58a73","Type":"ContainerStarted","Data":"caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9"} Jun 11 15:31:16.802469 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.802369 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" podUID="bd243c81-ddd8-4823-83e6-ed0d12a58a73" containerName="authorino" containerID="cri-o://caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9" gracePeriod=30 Jun 11 15:31:16.818758 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.818716 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" podStartSLOduration=1.4950086439999999 podStartE2EDuration="1.818704276s" totalImagesPullingTime="323.695632ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:16.81690758 +0000 UTC m=+825.833058856" watchObservedRunningTime="2026-06-11 15:31:16.818704276 +0000 UTC m=+825.834855528" Jun 11 15:31:16.833668 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.833625 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" podStartSLOduration=1.457039309 podStartE2EDuration="1.833612054s" totalImagesPullingTime="376.572745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:16.832371458 +0000 UTC m=+825.848522733" watchObservedRunningTime="2026-06-11 15:31:16.833612054 +0000 UTC m=+825.849763328" Jun 11 15:31:16.851175 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.851148 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dn67n"] Jun 11 15:31:16.851377 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.851354 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dn67n" podUID="a0171f90-570b-4ef0-8309-731aad22c32e" containerName="authorino" containerID="cri-o://48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956" gracePeriod=30 Jun 11 15:31:16.854169 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:16.854118 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5997cb768f-xnttm" podStartSLOduration=1.453158855 podStartE2EDuration="1.854097957s" totalImagesPullingTime="400.939102ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:31:16.852610007 +0000 UTC m=+825.868761286" watchObservedRunningTime="2026-06-11 15:31:16.854097957 +0000 UTC m=+825.870249236" Jun 11 15:31:17.049348 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.049326 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5997cb768f-xnttm" Jun 11 15:31:17.097700 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.097667 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w66tt\" (UniqueName: \"kubernetes.io/projected/1c6fe02e-fe4a-4387-b3b9-4f086ce915f5-kube-api-access-w66tt\") pod \"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5\" (UID: \"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5\") " Jun 11 15:31:17.099807 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.099742 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c6fe02e-fe4a-4387-b3b9-4f086ce915f5-kube-api-access-w66tt" (OuterVolumeSpecName: "kube-api-access-w66tt") pod "1c6fe02e-fe4a-4387-b3b9-4f086ce915f5" (UID: "1c6fe02e-fe4a-4387-b3b9-4f086ce915f5"). InnerVolumeSpecName "kube-api-access-w66tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:31:17.106545 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.106522 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" Jun 11 15:31:17.113711 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.113693 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dn67n" Jun 11 15:31:17.198303 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.198278 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pfj2l\" (UniqueName: \"kubernetes.io/projected/bd243c81-ddd8-4823-83e6-ed0d12a58a73-kube-api-access-pfj2l\") pod \"bd243c81-ddd8-4823-83e6-ed0d12a58a73\" (UID: \"bd243c81-ddd8-4823-83e6-ed0d12a58a73\") " Jun 11 15:31:17.198468 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.198330 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kscv4\" (UniqueName: \"kubernetes.io/projected/a0171f90-570b-4ef0-8309-731aad22c32e-kube-api-access-kscv4\") pod \"a0171f90-570b-4ef0-8309-731aad22c32e\" (UID: \"a0171f90-570b-4ef0-8309-731aad22c32e\") " Jun 11 15:31:17.198545 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.198534 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w66tt\" (UniqueName: \"kubernetes.io/projected/1c6fe02e-fe4a-4387-b3b9-4f086ce915f5-kube-api-access-w66tt\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:31:17.200433 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.200400 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd243c81-ddd8-4823-83e6-ed0d12a58a73-kube-api-access-pfj2l" (OuterVolumeSpecName: "kube-api-access-pfj2l") pod "bd243c81-ddd8-4823-83e6-ed0d12a58a73" (UID: "bd243c81-ddd8-4823-83e6-ed0d12a58a73"). InnerVolumeSpecName "kube-api-access-pfj2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:31:17.200568 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.200544 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0171f90-570b-4ef0-8309-731aad22c32e-kube-api-access-kscv4" (OuterVolumeSpecName: "kube-api-access-kscv4") pod "a0171f90-570b-4ef0-8309-731aad22c32e" (UID: "a0171f90-570b-4ef0-8309-731aad22c32e"). InnerVolumeSpecName "kube-api-access-kscv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:31:17.299185 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.299105 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pfj2l\" (UniqueName: \"kubernetes.io/projected/bd243c81-ddd8-4823-83e6-ed0d12a58a73-kube-api-access-pfj2l\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:31:17.299185 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.299128 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kscv4\" (UniqueName: \"kubernetes.io/projected/a0171f90-570b-4ef0-8309-731aad22c32e-kube-api-access-kscv4\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:31:17.807606 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.807517 2574 generic.go:356] "Generic (PLEG): container finished" podID="a0171f90-570b-4ef0-8309-731aad22c32e" containerID="48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956" exitCode=0 Jun 11 15:31:17.807606 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.807558 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dn67n" Jun 11 15:31:17.808127 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.807608 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dn67n" event={"ID":"a0171f90-570b-4ef0-8309-731aad22c32e","Type":"ContainerDied","Data":"48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956"} Jun 11 15:31:17.808127 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.807652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dn67n" event={"ID":"a0171f90-570b-4ef0-8309-731aad22c32e","Type":"ContainerDied","Data":"16fe41fe3655f9fd8b956d0cfb09d82cf2ed9b072762a2d46c990b7903be7367"} Jun 11 15:31:17.808127 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.807668 2574 scope.go:117] "RemoveContainer" containerID="48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956" Jun 11 15:31:17.809044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.808964 2574 generic.go:356] "Generic (PLEG): container finished" podID="1c6fe02e-fe4a-4387-b3b9-4f086ce915f5" containerID="eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8" exitCode=0 Jun 11 15:31:17.809044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.808999 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5997cb768f-xnttm" Jun 11 15:31:17.809044 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.809041 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5997cb768f-xnttm" event={"ID":"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5","Type":"ContainerDied","Data":"eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8"} Jun 11 15:31:17.809204 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.809067 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5997cb768f-xnttm" event={"ID":"1c6fe02e-fe4a-4387-b3b9-4f086ce915f5","Type":"ContainerDied","Data":"f21a76886d2e572a5d352e9530d237de35565544224255700b12e94061012f06"} Jun 11 15:31:17.810544 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.810521 2574 generic.go:356] "Generic (PLEG): container finished" podID="bd243c81-ddd8-4823-83e6-ed0d12a58a73" containerID="caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9" exitCode=0 Jun 11 15:31:17.810683 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.810558 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" Jun 11 15:31:17.810683 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.810610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" event={"ID":"bd243c81-ddd8-4823-83e6-ed0d12a58a73","Type":"ContainerDied","Data":"caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9"} Jun 11 15:31:17.810683 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.810642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-m9fxh" event={"ID":"bd243c81-ddd8-4823-83e6-ed0d12a58a73","Type":"ContainerDied","Data":"b0e8513b908147bdc80f303d1ff1641b1d12850d3c2312b7bf04eac337041f37"} Jun 11 15:31:17.817398 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.817382 2574 scope.go:117] "RemoveContainer" containerID="48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956" Jun 11 15:31:17.817630 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:31:17.817614 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956\": container with ID starting with 48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956 not found: ID does not exist" containerID="48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956" Jun 11 15:31:17.817676 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.817636 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956"} err="failed to get container status \"48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956\": rpc error: code = NotFound desc = could not find container \"48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956\": container with ID starting with 48aa7803a6372ba5d1938afb4257657fcba411a4179d612e494cbc1826f25956 not found: ID does not exist" Jun 11 15:31:17.817676 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.817650 2574 scope.go:117] "RemoveContainer" containerID="eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8" Jun 11 15:31:17.825000 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.824984 2574 scope.go:117] "RemoveContainer" containerID="eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8" Jun 11 15:31:17.825258 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:31:17.825240 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8\": container with ID starting with eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8 not found: ID does not exist" containerID="eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8" Jun 11 15:31:17.825300 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.825263 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8"} err="failed to get container status \"eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8\": rpc error: code = NotFound desc = could not find container \"eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8\": container with ID starting with eb67d3d01f13a4ce1dc2d0e2e217712becf964c6ed916eeee90501a6e3e2c1a8 not found: ID does not exist" Jun 11 15:31:17.825300 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.825278 2574 scope.go:117] "RemoveContainer" containerID="caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9" Jun 11 15:31:17.832742 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.832716 2574 scope.go:117] "RemoveContainer" containerID="caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9" Jun 11 15:31:17.833071 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:31:17.833044 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9\": container with ID starting with caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9 not found: ID does not exist" containerID="caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9" Jun 11 15:31:17.833217 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.833080 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9"} err="failed to get container status \"caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9\": rpc error: code = NotFound desc = could not find container \"caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9\": container with ID starting with caf7b776ea8022825b951da273198a2dbf69859522b698d1dc7121dccd026ca9 not found: ID does not exist" Jun 11 15:31:17.833217 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.833055 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m9fxh"] Jun 11 15:31:17.834816 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.834800 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-m9fxh"] Jun 11 15:31:17.845869 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.845848 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5997cb768f-xnttm"] Jun 11 15:31:17.850623 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.850604 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5997cb768f-xnttm"] Jun 11 15:31:17.861518 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.861498 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dn67n"] Jun 11 15:31:17.871453 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:17.871433 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dn67n"] Jun 11 15:31:19.439205 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:19.439176 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c6fe02e-fe4a-4387-b3b9-4f086ce915f5" path="/var/lib/kubelet/pods/1c6fe02e-fe4a-4387-b3b9-4f086ce915f5/volumes" Jun 11 15:31:19.439540 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:19.439492 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0171f90-570b-4ef0-8309-731aad22c32e" path="/var/lib/kubelet/pods/a0171f90-570b-4ef0-8309-731aad22c32e/volumes" Jun 11 15:31:19.439767 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:19.439754 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd243c81-ddd8-4823-83e6-ed0d12a58a73" path="/var/lib/kubelet/pods/bd243c81-ddd8-4823-83e6-ed0d12a58a73/volumes" Jun 11 15:31:56.114368 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:31:56.114334 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:32:31.464022 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:32:31.463993 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:32:31.464441 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:32:31.464248 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:34:47.244065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244032 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-558cbc4885-pdl9m"] Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244380 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd243c81-ddd8-4823-83e6-ed0d12a58a73" containerName="authorino" Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244392 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd243c81-ddd8-4823-83e6-ed0d12a58a73" containerName="authorino" Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244409 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c6fe02e-fe4a-4387-b3b9-4f086ce915f5" containerName="authorino" Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244414 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c6fe02e-fe4a-4387-b3b9-4f086ce915f5" containerName="authorino" Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244425 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0171f90-570b-4ef0-8309-731aad22c32e" containerName="authorino" Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244430 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0171f90-570b-4ef0-8309-731aad22c32e" containerName="authorino" Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244487 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0171f90-570b-4ef0-8309-731aad22c32e" containerName="authorino" Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244495 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c6fe02e-fe4a-4387-b3b9-4f086ce915f5" containerName="authorino" Jun 11 15:34:47.244538 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.244502 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd243c81-ddd8-4823-83e6-ed0d12a58a73" containerName="authorino" Jun 11 15:34:47.246445 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.246428 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.249382 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.249358 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 15:34:47.255662 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.255638 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-558cbc4885-pdl9m"] Jun 11 15:34:47.396536 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.396501 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt687\" (UniqueName: \"kubernetes.io/projected/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-kube-api-access-jt687\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.396690 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.396543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-tls-cert\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.396690 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.396566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-oidc-ca\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.497192 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.497107 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt687\" (UniqueName: \"kubernetes.io/projected/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-kube-api-access-jt687\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.497192 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.497155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-tls-cert\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.497192 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.497189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-oidc-ca\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.497890 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.497859 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-oidc-ca\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.499618 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.499596 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-tls-cert\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.506397 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.506370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt687\" (UniqueName: \"kubernetes.io/projected/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-kube-api-access-jt687\") pod \"authorino-558cbc4885-pdl9m\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.556890 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.556855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:34:47.686270 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.686238 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-558cbc4885-pdl9m"] Jun 11 15:34:47.689443 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:34:47.689417 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bfbf0f9_0afd_4913_bc55_0b4161ea60fc.slice/crio-65fabe7a41fa1cf4b49ddc2ee5c5bf88aa4bdcfed243678b6ede9ea4d458fb06 WatchSource:0}: Error finding container 65fabe7a41fa1cf4b49ddc2ee5c5bf88aa4bdcfed243678b6ede9ea4d458fb06: Status 404 returned error can't find the container with id 65fabe7a41fa1cf4b49ddc2ee5c5bf88aa4bdcfed243678b6ede9ea4d458fb06 Jun 11 15:34:47.772935 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:47.772864 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-558cbc4885-pdl9m" event={"ID":"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc","Type":"ContainerStarted","Data":"65fabe7a41fa1cf4b49ddc2ee5c5bf88aa4bdcfed243678b6ede9ea4d458fb06"} Jun 11 15:34:48.779105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:48.779068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-558cbc4885-pdl9m" event={"ID":"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc","Type":"ContainerStarted","Data":"6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22"} Jun 11 15:34:48.805890 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:48.805836 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-558cbc4885-pdl9m" podStartSLOduration=1.434349659 podStartE2EDuration="1.80582033s" totalImagesPullingTime="371.470671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:34:48.805295078 +0000 UTC m=+1037.821446354" watchObservedRunningTime="2026-06-11 15:34:48.80582033 +0000 UTC m=+1037.821971605" Jun 11 15:34:48.847101 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:48.847070 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c6cfb7585-vszdf"] Jun 11 15:34:48.847272 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:48.847230 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" podUID="08fe080d-e78a-4e29-9fcc-771cd85d492e" containerName="authorino" containerID="cri-o://e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b" gracePeriod=30 Jun 11 15:34:49.088532 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.088509 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:34:49.212322 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.212292 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj45l\" (UniqueName: \"kubernetes.io/projected/08fe080d-e78a-4e29-9fcc-771cd85d492e-kube-api-access-xj45l\") pod \"08fe080d-e78a-4e29-9fcc-771cd85d492e\" (UID: \"08fe080d-e78a-4e29-9fcc-771cd85d492e\") " Jun 11 15:34:49.212472 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.212411 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08fe080d-e78a-4e29-9fcc-771cd85d492e-tls-cert\") pod \"08fe080d-e78a-4e29-9fcc-771cd85d492e\" (UID: \"08fe080d-e78a-4e29-9fcc-771cd85d492e\") " Jun 11 15:34:49.214353 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.214319 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08fe080d-e78a-4e29-9fcc-771cd85d492e-kube-api-access-xj45l" (OuterVolumeSpecName: "kube-api-access-xj45l") pod "08fe080d-e78a-4e29-9fcc-771cd85d492e" (UID: "08fe080d-e78a-4e29-9fcc-771cd85d492e"). InnerVolumeSpecName "kube-api-access-xj45l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:34:49.221960 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.221934 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08fe080d-e78a-4e29-9fcc-771cd85d492e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "08fe080d-e78a-4e29-9fcc-771cd85d492e" (UID: "08fe080d-e78a-4e29-9fcc-771cd85d492e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:34:49.313613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.313582 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/08fe080d-e78a-4e29-9fcc-771cd85d492e-tls-cert\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:34:49.313613 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.313606 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj45l\" (UniqueName: \"kubernetes.io/projected/08fe080d-e78a-4e29-9fcc-771cd85d492e-kube-api-access-xj45l\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:34:49.785362 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.785273 2574 generic.go:356] "Generic (PLEG): container finished" podID="08fe080d-e78a-4e29-9fcc-771cd85d492e" containerID="e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b" exitCode=0 Jun 11 15:34:49.785362 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.785315 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" Jun 11 15:34:49.785764 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.785363 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" event={"ID":"08fe080d-e78a-4e29-9fcc-771cd85d492e","Type":"ContainerDied","Data":"e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b"} Jun 11 15:34:49.785764 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.785405 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7c6cfb7585-vszdf" event={"ID":"08fe080d-e78a-4e29-9fcc-771cd85d492e","Type":"ContainerDied","Data":"3347f29f0f1bcccec976af36e2572688fa36704848ff3430ed72564ecdf32475"} Jun 11 15:34:49.785764 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.785427 2574 scope.go:117] "RemoveContainer" containerID="e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b" Jun 11 15:34:49.794078 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.794062 2574 scope.go:117] "RemoveContainer" containerID="e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b" Jun 11 15:34:49.794328 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:34:49.794309 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b\": container with ID starting with e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b not found: ID does not exist" containerID="e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b" Jun 11 15:34:49.794400 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.794335 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b"} err="failed to get container status \"e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b\": rpc error: code = NotFound desc = could not find container \"e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b\": container with ID starting with e52d73067492d0801a4c487274abc8b451f7b9681784d33222cfc533f4e9511b not found: ID does not exist" Jun 11 15:34:49.802049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.802028 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c6cfb7585-vszdf"] Jun 11 15:34:49.805901 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:49.805873 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c6cfb7585-vszdf"] Jun 11 15:34:51.439983 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:34:51.439949 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08fe080d-e78a-4e29-9fcc-771cd85d492e" path="/var/lib/kubelet/pods/08fe080d-e78a-4e29-9fcc-771cd85d492e/volumes" Jun 11 15:35:00.715535 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:00.715500 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:35:04.475499 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.475464 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt"] Jun 11 15:35:04.476049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.476031 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08fe080d-e78a-4e29-9fcc-771cd85d492e" containerName="authorino" Jun 11 15:35:04.476049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.476049 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="08fe080d-e78a-4e29-9fcc-771cd85d492e" containerName="authorino" Jun 11 15:35:04.476208 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.476186 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="08fe080d-e78a-4e29-9fcc-771cd85d492e" containerName="authorino" Jun 11 15:35:04.483625 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.483599 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.486482 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.486460 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 15:35:04.487357 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.487314 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 15:35:04.487357 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.487317 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-d7ns9\"" Jun 11 15:35:04.487518 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.487345 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 11 15:35:04.490286 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.490261 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt"] Jun 11 15:35:04.550089 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.550056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9dmv\" (UniqueName: \"kubernetes.io/projected/37728d98-d845-4780-a486-5ff3dbd839ba-kube-api-access-t9dmv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.550226 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.550149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.550226 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.550170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.550226 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.550198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.550351 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.550231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37728d98-d845-4780-a486-5ff3dbd839ba-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.550351 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.550254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651071 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651037 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651071 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651329 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651094 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651329 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651120 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37728d98-d845-4780-a486-5ff3dbd839ba-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651329 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651143 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651329 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651173 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9dmv\" (UniqueName: \"kubernetes.io/projected/37728d98-d845-4780-a486-5ff3dbd839ba-kube-api-access-t9dmv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651531 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651507 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651571 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.651618 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.651598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.653431 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.653407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37728d98-d845-4780-a486-5ff3dbd839ba-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.653696 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.653679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37728d98-d845-4780-a486-5ff3dbd839ba-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.659621 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.659598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9dmv\" (UniqueName: \"kubernetes.io/projected/37728d98-d845-4780-a486-5ff3dbd839ba-kube-api-access-t9dmv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6hlxt\" (UID: \"37728d98-d845-4780-a486-5ff3dbd839ba\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.795734 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.795640 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:04.935999 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.935971 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt"] Jun 11 15:35:04.938658 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:35:04.938628 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37728d98_d845_4780_a486_5ff3dbd839ba.slice/crio-cdee25c984f4664229e87429d8fbbf25926ab0379930d57bddd31243d9f03773 WatchSource:0}: Error finding container cdee25c984f4664229e87429d8fbbf25926ab0379930d57bddd31243d9f03773: Status 404 returned error can't find the container with id cdee25c984f4664229e87429d8fbbf25926ab0379930d57bddd31243d9f03773 Jun 11 15:35:04.940562 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:04.940542 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 15:35:05.054688 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:05.054600 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:35:05.863689 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:05.863650 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" event={"ID":"37728d98-d845-4780-a486-5ff3dbd839ba","Type":"ContainerStarted","Data":"cdee25c984f4664229e87429d8fbbf25926ab0379930d57bddd31243d9f03773"} Jun 11 15:35:07.877039 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:07.877002 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" event={"ID":"37728d98-d845-4780-a486-5ff3dbd839ba","Type":"ContainerStarted","Data":"56d591731a3e12d940a502ff4d87734d4289dc3a762ff6c95b3f55b96dee1750"} Jun 11 15:35:09.889665 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:09.889626 2574 generic.go:356] "Generic (PLEG): container finished" podID="37728d98-d845-4780-a486-5ff3dbd839ba" containerID="56d591731a3e12d940a502ff4d87734d4289dc3a762ff6c95b3f55b96dee1750" exitCode=0 Jun 11 15:35:09.890072 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:09.889701 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" event={"ID":"37728d98-d845-4780-a486-5ff3dbd839ba","Type":"ContainerDied","Data":"56d591731a3e12d940a502ff4d87734d4289dc3a762ff6c95b3f55b96dee1750"} Jun 11 15:35:11.903748 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:11.903711 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" event={"ID":"37728d98-d845-4780-a486-5ff3dbd839ba","Type":"ContainerStarted","Data":"1bb0cd387a9dde401f1f6d6c85195ed69f2c0e26881bea98cfeee3aefb6a50f2"} Jun 11 15:35:11.930585 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:11.930541 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" podStartSLOduration=2.59157666 podStartE2EDuration="7.930528001s" totalImagesPullingTime="4.078355206s" totalInitContainerRuntime="1.260596135s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:35:11.927619013 +0000 UTC m=+1060.943770288" watchObservedRunningTime="2026-06-11 15:35:11.930528001 +0000 UTC m=+1060.946679276" Jun 11 15:35:14.796129 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:14.796093 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:14.796517 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:14.796158 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:14.808630 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:14.808607 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:14.934146 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:14.934116 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6hlxt" Jun 11 15:35:25.070173 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:25.070091 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:35:36.378730 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.378700 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f"] Jun 11 15:35:36.383488 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.383472 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.386367 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.386347 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 15:35:36.400550 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.400528 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f"] Jun 11 15:35:36.450543 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.450520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.450638 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.450556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.450638 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.450584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.450638 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.450600 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqxk8\" (UniqueName: \"kubernetes.io/projected/a479b103-7dda-4cee-bc68-969b4637617d-kube-api-access-kqxk8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.450743 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.450704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a479b103-7dda-4cee-bc68-969b4637617d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.450743 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.450737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.551622 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.551592 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.551767 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.551643 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.551767 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.551662 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqxk8\" (UniqueName: \"kubernetes.io/projected/a479b103-7dda-4cee-bc68-969b4637617d-kube-api-access-kqxk8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.551767 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.551731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a479b103-7dda-4cee-bc68-969b4637617d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.551767 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.551751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.552001 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.551814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.552146 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.552120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.552274 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.552176 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.552274 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.552201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.553908 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.553886 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a479b103-7dda-4cee-bc68-969b4637617d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.554170 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.554153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a479b103-7dda-4cee-bc68-969b4637617d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.570201 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.570181 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqxk8\" (UniqueName: \"kubernetes.io/projected/a479b103-7dda-4cee-bc68-969b4637617d-kube-api-access-kqxk8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f\" (UID: \"a479b103-7dda-4cee-bc68-969b4637617d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.693407 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.693379 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:36.829509 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:36.829484 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f"] Jun 11 15:35:36.831542 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:35:36.831517 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda479b103_7dda_4cee_bc68_969b4637617d.slice/crio-b6fe8f0fbe3767705c6bb6e3811391c5edb5d76a19502c05080d6b18d36293ca WatchSource:0}: Error finding container b6fe8f0fbe3767705c6bb6e3811391c5edb5d76a19502c05080d6b18d36293ca: Status 404 returned error can't find the container with id b6fe8f0fbe3767705c6bb6e3811391c5edb5d76a19502c05080d6b18d36293ca Jun 11 15:35:37.029306 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:37.029209 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" event={"ID":"a479b103-7dda-4cee-bc68-969b4637617d","Type":"ContainerStarted","Data":"341ccf848020953204b23f157d4484287cad215f3c1754fbaedbaed601e483b4"} Jun 11 15:35:37.029306 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:37.029266 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" event={"ID":"a479b103-7dda-4cee-bc68-969b4637617d","Type":"ContainerStarted","Data":"b6fe8f0fbe3767705c6bb6e3811391c5edb5d76a19502c05080d6b18d36293ca"} Jun 11 15:35:37.163125 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:37.163085 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:35:42.055017 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:42.054980 2574 generic.go:356] "Generic (PLEG): container finished" podID="a479b103-7dda-4cee-bc68-969b4637617d" containerID="341ccf848020953204b23f157d4484287cad215f3c1754fbaedbaed601e483b4" exitCode=0 Jun 11 15:35:42.055495 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:42.055050 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" event={"ID":"a479b103-7dda-4cee-bc68-969b4637617d","Type":"ContainerDied","Data":"341ccf848020953204b23f157d4484287cad215f3c1754fbaedbaed601e483b4"} Jun 11 15:35:43.061055 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:43.061023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" event={"ID":"a479b103-7dda-4cee-bc68-969b4637617d","Type":"ContainerStarted","Data":"83fb6c9a41ce50f0c1b6740f08f109e10cea4c7532cb5f01c4c8c057ec875914"} Jun 11 15:35:43.088325 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:43.088280 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" podStartSLOduration=2.6940492320000002 podStartE2EDuration="7.088265353s" totalImagesPullingTime="237.537122ms" totalInitContainerRuntime="4.156678999s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:35:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:35:43.085529723 +0000 UTC m=+1092.101680996" watchObservedRunningTime="2026-06-11 15:35:43.088265353 +0000 UTC m=+1092.104416617" Jun 11 15:35:46.694077 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:46.694039 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:46.694511 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:46.694099 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:46.706525 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:46.706500 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:47.090409 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:47.090332 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f" Jun 11 15:35:51.263717 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:35:51.263677 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:36:02.306440 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.306399 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx"] Jun 11 15:36:02.309934 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.309917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.315762 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.315744 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 15:36:02.333464 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.332531 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx"] Jun 11 15:36:02.385564 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.385528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.385697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.385567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgbs6\" (UniqueName: \"kubernetes.io/projected/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-kube-api-access-vgbs6\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.385697 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.385599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.385793 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.385689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.385793 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.385763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.385868 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.385805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486299 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486434 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486434 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486434 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486373 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486434 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgbs6\" (UniqueName: \"kubernetes.io/projected/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-kube-api-access-vgbs6\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486434 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486718 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486807 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.486883 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.486800 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.488553 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.488535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.488717 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.488701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.501051 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.501031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgbs6\" (UniqueName: \"kubernetes.io/projected/e2f88daa-828d-4fc9-b4a7-bf8203911a0b-kube-api-access-vgbs6\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-l5bjx\" (UID: \"e2f88daa-828d-4fc9-b4a7-bf8203911a0b\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.619275 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.619197 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:02.754852 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:02.754829 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx"] Jun 11 15:36:02.756528 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:36:02.756500 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f88daa_828d_4fc9_b4a7_bf8203911a0b.slice/crio-a8ab6099b44b5bb71512c019f087a9e3a37eea9e443262adcfc5d9b2c4a6a6b2 WatchSource:0}: Error finding container a8ab6099b44b5bb71512c019f087a9e3a37eea9e443262adcfc5d9b2c4a6a6b2: Status 404 returned error can't find the container with id a8ab6099b44b5bb71512c019f087a9e3a37eea9e443262adcfc5d9b2c4a6a6b2 Jun 11 15:36:03.154186 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:03.154148 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" event={"ID":"e2f88daa-828d-4fc9-b4a7-bf8203911a0b","Type":"ContainerStarted","Data":"59f1911b4b63bb55f3f02e5369348a15d20c1e99b08f989062ecaf102b063b91"} Jun 11 15:36:03.154364 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:03.154200 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" event={"ID":"e2f88daa-828d-4fc9-b4a7-bf8203911a0b","Type":"ContainerStarted","Data":"a8ab6099b44b5bb71512c019f087a9e3a37eea9e443262adcfc5d9b2c4a6a6b2"} Jun 11 15:36:03.666422 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:03.666387 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:36:05.165556 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:05.165523 2574 generic.go:356] "Generic (PLEG): container finished" podID="e2f88daa-828d-4fc9-b4a7-bf8203911a0b" containerID="59f1911b4b63bb55f3f02e5369348a15d20c1e99b08f989062ecaf102b063b91" exitCode=0 Jun 11 15:36:05.165957 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:05.165586 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" event={"ID":"e2f88daa-828d-4fc9-b4a7-bf8203911a0b","Type":"ContainerDied","Data":"59f1911b4b63bb55f3f02e5369348a15d20c1e99b08f989062ecaf102b063b91"} Jun 11 15:36:06.174634 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:06.174597 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" event={"ID":"e2f88daa-828d-4fc9-b4a7-bf8203911a0b","Type":"ContainerStarted","Data":"dde7c87b1ff9fe5c96f85c19fb9c043014d65b4936eab4628fdac7b76ebf44d8"} Jun 11 15:36:06.197513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:06.197455 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" podStartSLOduration=2.432715112 podStartE2EDuration="4.197439389s" totalImagesPullingTime="411.858198ms" totalInitContainerRuntime="1.352866079s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:36:06.196045838 +0000 UTC m=+1115.212197114" watchObservedRunningTime="2026-06-11 15:36:06.197439389 +0000 UTC m=+1115.213590663" Jun 11 15:36:12.619313 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:12.619274 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:12.619825 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:12.619547 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:12.632241 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:12.632214 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:36:13.220201 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:36:13.220173 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-l5bjx" Jun 11 15:37:31.496688 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:31.496653 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:37:31.498699 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:31.498678 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:37:42.754983 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.754950 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5749f6bd48-9m2p6"] Jun 11 15:37:42.758388 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.758370 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.767277 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.767254 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5749f6bd48-9m2p6"] Jun 11 15:37:42.839283 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.839249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be9178b1-fe70-42f3-b623-db69f0b85d12-oidc-ca\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.839469 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.839390 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be9178b1-fe70-42f3-b623-db69f0b85d12-tls-cert\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.839469 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.839438 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48mjs\" (UniqueName: \"kubernetes.io/projected/be9178b1-fe70-42f3-b623-db69f0b85d12-kube-api-access-48mjs\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.940940 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.940903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be9178b1-fe70-42f3-b623-db69f0b85d12-tls-cert\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.940940 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.940939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48mjs\" (UniqueName: \"kubernetes.io/projected/be9178b1-fe70-42f3-b623-db69f0b85d12-kube-api-access-48mjs\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.941156 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.940969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be9178b1-fe70-42f3-b623-db69f0b85d12-oidc-ca\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.941645 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.941627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/be9178b1-fe70-42f3-b623-db69f0b85d12-oidc-ca\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.943403 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.943370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/be9178b1-fe70-42f3-b623-db69f0b85d12-tls-cert\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:42.950378 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:42.950354 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48mjs\" (UniqueName: \"kubernetes.io/projected/be9178b1-fe70-42f3-b623-db69f0b85d12-kube-api-access-48mjs\") pod \"authorino-5749f6bd48-9m2p6\" (UID: \"be9178b1-fe70-42f3-b623-db69f0b85d12\") " pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:43.068310 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:43.068224 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5749f6bd48-9m2p6" Jun 11 15:37:43.216954 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:43.216926 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5749f6bd48-9m2p6"] Jun 11 15:37:43.219559 ip-10-0-142-103 kubenswrapper[2574]: W0611 15:37:43.219485 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe9178b1_fe70_42f3_b623_db69f0b85d12.slice/crio-da3493763ebaa1fee94b79933aae6b2ec32f28723591a6db73a881881f7e6bec WatchSource:0}: Error finding container da3493763ebaa1fee94b79933aae6b2ec32f28723591a6db73a881881f7e6bec: Status 404 returned error can't find the container with id da3493763ebaa1fee94b79933aae6b2ec32f28723591a6db73a881881f7e6bec Jun 11 15:37:43.630398 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:43.630353 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5749f6bd48-9m2p6" event={"ID":"be9178b1-fe70-42f3-b623-db69f0b85d12","Type":"ContainerStarted","Data":"da3493763ebaa1fee94b79933aae6b2ec32f28723591a6db73a881881f7e6bec"} Jun 11 15:37:44.639411 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:44.638658 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5749f6bd48-9m2p6" event={"ID":"be9178b1-fe70-42f3-b623-db69f0b85d12","Type":"ContainerStarted","Data":"f68c9bc1bae89d3fc4206957787d7752a4c4fbba6e3088cff793a2d33184ead1"} Jun 11 15:37:44.669968 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:44.669916 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5749f6bd48-9m2p6" podStartSLOduration=2.10581895 podStartE2EDuration="2.669891818s" totalImagesPullingTime="564.072868ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:37:44.668642508 +0000 UTC m=+1213.684793785" watchObservedRunningTime="2026-06-11 15:37:44.669891818 +0000 UTC m=+1213.686043092" Jun 11 15:37:44.720882 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:44.720842 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-558cbc4885-pdl9m"] Jun 11 15:37:44.721090 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:44.721056 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-558cbc4885-pdl9m" podUID="4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" containerName="authorino" containerID="cri-o://6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22" gracePeriod=30 Jun 11 15:37:44.999536 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:44.999511 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:37:45.060960 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.060927 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jt687\" (UniqueName: \"kubernetes.io/projected/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-kube-api-access-jt687\") pod \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " Jun 11 15:37:45.061125 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.060995 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-tls-cert\") pod \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " Jun 11 15:37:45.061173 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.061151 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-oidc-ca\") pod \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\" (UID: \"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc\") " Jun 11 15:37:45.063029 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.062997 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-kube-api-access-jt687" (OuterVolumeSpecName: "kube-api-access-jt687") pod "4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" (UID: "4bfbf0f9-0afd-4913-bc55-0b4161ea60fc"). InnerVolumeSpecName "kube-api-access-jt687". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:37:45.067196 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.067174 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" (UID: "4bfbf0f9-0afd-4913-bc55-0b4161ea60fc"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 15:37:45.071083 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.071060 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" (UID: "4bfbf0f9-0afd-4913-bc55-0b4161ea60fc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 15:37:45.161998 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.161904 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jt687\" (UniqueName: \"kubernetes.io/projected/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-kube-api-access-jt687\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:37:45.161998 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.161942 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-tls-cert\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:37:45.161998 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.161951 2574 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc-oidc-ca\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:37:45.644316 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.644282 2574 generic.go:356] "Generic (PLEG): container finished" podID="4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" containerID="6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22" exitCode=0 Jun 11 15:37:45.644874 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.644327 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-558cbc4885-pdl9m" Jun 11 15:37:45.644874 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.644382 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-558cbc4885-pdl9m" event={"ID":"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc","Type":"ContainerDied","Data":"6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22"} Jun 11 15:37:45.644874 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.644433 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-558cbc4885-pdl9m" event={"ID":"4bfbf0f9-0afd-4913-bc55-0b4161ea60fc","Type":"ContainerDied","Data":"65fabe7a41fa1cf4b49ddc2ee5c5bf88aa4bdcfed243678b6ede9ea4d458fb06"} Jun 11 15:37:45.644874 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.644459 2574 scope.go:117] "RemoveContainer" containerID="6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22" Jun 11 15:37:45.654715 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.654455 2574 scope.go:117] "RemoveContainer" containerID="6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22" Jun 11 15:37:45.655075 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:37:45.655040 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22\": container with ID starting with 6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22 not found: ID does not exist" containerID="6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22" Jun 11 15:37:45.655157 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.655086 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22"} err="failed to get container status \"6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22\": rpc error: code = NotFound desc = could not find container \"6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22\": container with ID starting with 6335ec8e3b267496ac59b20372d43e80771bbe75950ad6b8f2b6d2a35c567c22 not found: ID does not exist" Jun 11 15:37:45.666530 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.666507 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-558cbc4885-pdl9m"] Jun 11 15:37:45.676250 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:45.676227 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-558cbc4885-pdl9m"] Jun 11 15:37:47.440596 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:37:47.440560 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" path="/var/lib/kubelet/pods/4bfbf0f9-0afd-4913-bc55-0b4161ea60fc/volumes" Jun 11 15:38:06.260283 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:38:06.260250 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:38:10.763792 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:38:10.763744 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:38:17.581049 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:38:17.581010 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:38:27.971041 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:38:27.970999 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:38:36.854551 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:38:36.854514 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:38:47.757313 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:38:47.757280 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:38:56.151073 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:38:56.151031 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:39:07.048966 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:39:07.048934 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:40:20.353803 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:40:20.353707 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:40:36.452852 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:40:36.452815 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:41:16.061955 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:41:16.061914 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:41:33.025847 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:41:33.025808 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:41:48.953545 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:41:48.953508 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:42:04.662151 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:42:04.662117 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:42:31.527522 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:42:31.527488 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:42:31.529622 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:42:31.529593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:43:07.444303 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:43:07.444273 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:43:16.243136 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:43:16.243094 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:43:33.057941 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:43:33.057897 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:43:41.466242 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:43:41.466204 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:43:59.349359 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:43:59.349321 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:44:07.561471 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:44:07.561437 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:44:39.952235 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:44:39.952195 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:44:48.983227 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:44:48.983186 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:44:57.446035 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:44:57.446002 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:45:05.144271 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:45:05.144232 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:45:13.744554 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:45:13.744522 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:45:22.453161 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:45:22.453127 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:45:26.379689 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:45:26.379649 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:45:39.348236 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:45:39.348198 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:45:50.959222 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:45:50.959135 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:46:38.658989 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:46:38.658947 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:46:46.454527 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:46:46.454492 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:47:05.463233 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:05.463189 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:47:10.151193 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:10.151155 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:47:14.249487 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:14.249447 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:47:23.253974 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:23.253878 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:47:31.557513 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:31.557476 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:47:31.560611 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:31.560587 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:47:31.847793 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:31.847693 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:47:40.951373 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:40.951330 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:47:50.349118 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:50.349080 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:47:58.475584 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:47:58.475548 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:48:06.556814 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:48:06.556767 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:48:15.257211 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:48:15.257175 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:48:23.556885 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:48:23.556848 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:49:25.662481 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:25.662390 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl"] Jun 11 15:49:25.663020 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:25.662586 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" podUID="cf8420bd-7e7d-4ee6-ba78-5729b10a85d1" containerName="manager" containerID="cri-o://291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2" gracePeriod=10 Jun 11 15:49:25.921906 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:25.921845 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:49:26.097251 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.097220 2574 generic.go:356] "Generic (PLEG): container finished" podID="cf8420bd-7e7d-4ee6-ba78-5729b10a85d1" containerID="291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2" exitCode=0 Jun 11 15:49:26.097433 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.097261 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" Jun 11 15:49:26.097433 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.097293 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" event={"ID":"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1","Type":"ContainerDied","Data":"291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2"} Jun 11 15:49:26.097433 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.097347 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl" event={"ID":"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1","Type":"ContainerDied","Data":"fe0a4db632700d31358a06057b4ea16f733052c68fc377e04fb9c071a25ae2b9"} Jun 11 15:49:26.097433 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.097369 2574 scope.go:117] "RemoveContainer" containerID="291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2" Jun 11 15:49:26.100745 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.100728 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-extensions-socket-volume\") pod \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\" (UID: \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\") " Jun 11 15:49:26.100841 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.100799 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tnxp\" (UniqueName: \"kubernetes.io/projected/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-kube-api-access-4tnxp\") pod \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\" (UID: \"cf8420bd-7e7d-4ee6-ba78-5729b10a85d1\") " Jun 11 15:49:26.101169 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.101137 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf8420bd-7e7d-4ee6-ba78-5729b10a85d1" (UID: "cf8420bd-7e7d-4ee6-ba78-5729b10a85d1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 15:49:26.102936 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.102911 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-kube-api-access-4tnxp" (OuterVolumeSpecName: "kube-api-access-4tnxp") pod "cf8420bd-7e7d-4ee6-ba78-5729b10a85d1" (UID: "cf8420bd-7e7d-4ee6-ba78-5729b10a85d1"). InnerVolumeSpecName "kube-api-access-4tnxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 15:49:26.106652 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.106610 2574 scope.go:117] "RemoveContainer" containerID="291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2" Jun 11 15:49:26.106894 ip-10-0-142-103 kubenswrapper[2574]: E0611 15:49:26.106868 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2\": container with ID starting with 291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2 not found: ID does not exist" containerID="291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2" Jun 11 15:49:26.106978 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.106897 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2"} err="failed to get container status \"291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2\": rpc error: code = NotFound desc = could not find container \"291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2\": container with ID starting with 291d5739b88f6ffa355e89eaa7d80d76a5be6936081dbea33f49e49c41b0d5a2 not found: ID does not exist" Jun 11 15:49:26.201938 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.201897 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tnxp\" (UniqueName: \"kubernetes.io/projected/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-kube-api-access-4tnxp\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:49:26.201938 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.201931 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1-extensions-socket-volume\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 15:49:26.422836 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.422809 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl"] Jun 11 15:49:26.426842 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:26.426818 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-84fxl"] Jun 11 15:49:27.440093 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:49:27.440051 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8420bd-7e7d-4ee6-ba78-5729b10a85d1" path="/var/lib/kubelet/pods/cf8420bd-7e7d-4ee6-ba78-5729b10a85d1/volumes" Jun 11 15:51:12.254449 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:51:12.254411 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:51:15.749459 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:51:15.749417 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:51:26.757054 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:51:26.757021 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:51:35.657354 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:51:35.657317 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:51:46.054840 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:51:46.054808 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:51:55.558291 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:51:55.558206 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:52:05.555865 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:52:05.555765 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:52:14.368322 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:52:14.368284 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:52:24.947156 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:52:24.947120 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:52:31.589245 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:52:31.589216 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:52:31.591473 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:52:31.591453 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:52:33.758218 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:52:33.758186 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:52:43.604403 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:52:43.604357 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:52:48.483834 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:52:48.483793 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:53:15.756485 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:53:15.756444 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:53:20.156819 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:53:20.156723 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:54:00.459516 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:54:00.459486 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:54:07.751815 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:54:07.751766 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:54:17.761105 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:54:17.761070 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:54:25.555438 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:54:25.555404 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:54:35.174841 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:54:35.174805 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:54:46.549073 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:54:46.549034 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:54:56.689252 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:54:56.689175 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:55:01.153103 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:55:01.153071 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:55:11.457089 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:55:11.457058 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:55:18.881709 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:55:18.881677 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:55:26.658421 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:55:26.658385 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:55:37.255643 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:55:37.255602 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:55:56.457610 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:55:56.457577 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:56:02.955065 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:56:02.955031 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:56:13.581008 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:56:13.580971 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:56:23.056315 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:56:23.056230 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:56:41.247812 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:56:41.247762 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:56:48.654037 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:56:48.654002 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:56:58.560946 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:56:58.560915 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:57:05.652792 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:57:05.652742 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:57:14.559635 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:57:14.559601 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:57:23.462420 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:57:23.462381 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:57:31.623535 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:57:31.623508 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:57:31.626753 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:57:31.626728 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 15:57:33.053225 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:57:33.053191 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:57:45.059217 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:57:45.059184 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:57:55.454987 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:57:55.454909 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:58:07.453845 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:58:07.453812 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:58:17.959916 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:58:17.959885 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:58:22.050920 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:58:22.050881 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:58:32.409395 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:58:32.409361 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:58:36.456458 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:58:36.456421 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:58:53.467881 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:58:53.467849 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:59:02.354328 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:59:02.354291 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:59:11.755015 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:59:11.754982 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:59:18.651413 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:59:18.651373 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:59:39.955607 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:59:39.955569 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 15:59:53.064274 ip-10-0-142-103 kubenswrapper[2574]: I0611 15:59:53.064241 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-krz2l"] Jun 11 16:00:00.142562 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.142527 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686560-248ck"] Jun 11 16:00:00.142976 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.142907 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8420bd-7e7d-4ee6-ba78-5729b10a85d1" containerName="manager" Jun 11 16:00:00.142976 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.142918 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8420bd-7e7d-4ee6-ba78-5729b10a85d1" containerName="manager" Jun 11 16:00:00.142976 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.142940 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" containerName="authorino" Jun 11 16:00:00.142976 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.142946 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" containerName="authorino" Jun 11 16:00:00.143121 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.143022 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bfbf0f9-0afd-4913-bc55-0b4161ea60fc" containerName="authorino" Jun 11 16:00:00.143121 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.143031 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8420bd-7e7d-4ee6-ba78-5729b10a85d1" containerName="manager" Jun 11 16:00:00.146137 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.146122 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686560-248ck" Jun 11 16:00:00.148436 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.148416 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-splzw\"" Jun 11 16:00:00.154914 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.154893 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686560-248ck"] Jun 11 16:00:00.248380 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.248341 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8frv8\" (UniqueName: \"kubernetes.io/projected/fb2ad92a-6a14-43c5-9a22-cdbe719fd305-kube-api-access-8frv8\") pod \"maas-api-key-cleanup-29686560-248ck\" (UID: \"fb2ad92a-6a14-43c5-9a22-cdbe719fd305\") " pod="opendatahub/maas-api-key-cleanup-29686560-248ck" Jun 11 16:00:00.348830 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.348753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8frv8\" (UniqueName: \"kubernetes.io/projected/fb2ad92a-6a14-43c5-9a22-cdbe719fd305-kube-api-access-8frv8\") pod \"maas-api-key-cleanup-29686560-248ck\" (UID: \"fb2ad92a-6a14-43c5-9a22-cdbe719fd305\") " pod="opendatahub/maas-api-key-cleanup-29686560-248ck" Jun 11 16:00:00.358299 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.358276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8frv8\" (UniqueName: \"kubernetes.io/projected/fb2ad92a-6a14-43c5-9a22-cdbe719fd305-kube-api-access-8frv8\") pod \"maas-api-key-cleanup-29686560-248ck\" (UID: \"fb2ad92a-6a14-43c5-9a22-cdbe719fd305\") " pod="opendatahub/maas-api-key-cleanup-29686560-248ck" Jun 11 16:00:00.456951 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.456922 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686560-248ck" Jun 11 16:00:00.798196 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.798162 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686560-248ck"] Jun 11 16:00:00.800664 ip-10-0-142-103 kubenswrapper[2574]: W0611 16:00:00.800640 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2ad92a_6a14_43c5_9a22_cdbe719fd305.slice/crio-1ae3a30d6bf8b5730cd438c2a294a1fb37ca11d9e7948281558bbd38724e30f4 WatchSource:0}: Error finding container 1ae3a30d6bf8b5730cd438c2a294a1fb37ca11d9e7948281558bbd38724e30f4: Status 404 returned error can't find the container with id 1ae3a30d6bf8b5730cd438c2a294a1fb37ca11d9e7948281558bbd38724e30f4 Jun 11 16:00:00.802641 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:00.802625 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:00:01.118016 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:01.117926 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686560-248ck" event={"ID":"fb2ad92a-6a14-43c5-9a22-cdbe719fd305","Type":"ContainerStarted","Data":"1ae3a30d6bf8b5730cd438c2a294a1fb37ca11d9e7948281558bbd38724e30f4"} Jun 11 16:00:18.201510 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:18.201470 2574 generic.go:356] "Generic (PLEG): container finished" podID="fb2ad92a-6a14-43c5-9a22-cdbe719fd305" containerID="a17d9380287aa4a73d710d3b9984148a894cc7c28e0eb9c05edd226ab8be82b1" exitCode=0 Jun 11 16:00:18.201946 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:18.201546 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686560-248ck" event={"ID":"fb2ad92a-6a14-43c5-9a22-cdbe719fd305","Type":"ContainerDied","Data":"a17d9380287aa4a73d710d3b9984148a894cc7c28e0eb9c05edd226ab8be82b1"} Jun 11 16:00:19.333441 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:19.333411 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686560-248ck" Jun 11 16:00:19.436975 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:19.436944 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8frv8\" (UniqueName: \"kubernetes.io/projected/fb2ad92a-6a14-43c5-9a22-cdbe719fd305-kube-api-access-8frv8\") pod \"fb2ad92a-6a14-43c5-9a22-cdbe719fd305\" (UID: \"fb2ad92a-6a14-43c5-9a22-cdbe719fd305\") " Jun 11 16:00:19.439209 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:19.439181 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb2ad92a-6a14-43c5-9a22-cdbe719fd305-kube-api-access-8frv8" (OuterVolumeSpecName: "kube-api-access-8frv8") pod "fb2ad92a-6a14-43c5-9a22-cdbe719fd305" (UID: "fb2ad92a-6a14-43c5-9a22-cdbe719fd305"). InnerVolumeSpecName "kube-api-access-8frv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:00:19.538540 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:19.538442 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8frv8\" (UniqueName: \"kubernetes.io/projected/fb2ad92a-6a14-43c5-9a22-cdbe719fd305-kube-api-access-8frv8\") on node \"ip-10-0-142-103.ec2.internal\" DevicePath \"\"" Jun 11 16:00:20.212704 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:20.212678 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686560-248ck" Jun 11 16:00:20.212900 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:20.212671 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686560-248ck" event={"ID":"fb2ad92a-6a14-43c5-9a22-cdbe719fd305","Type":"ContainerDied","Data":"1ae3a30d6bf8b5730cd438c2a294a1fb37ca11d9e7948281558bbd38724e30f4"} Jun 11 16:00:20.212900 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:20.212823 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ae3a30d6bf8b5730cd438c2a294a1fb37ca11d9e7948281558bbd38724e30f4" Jun 11 16:00:27.853703 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:27.853674 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5749f6bd48-9m2p6_be9178b1-fe70-42f3-b623-db69f0b85d12/authorino/0.log" Jun 11 16:00:33.477519 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:33.477495 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686560-248ck_fb2ad92a-6a14-43c5-9a22-cdbe719fd305/cleanup/0.log" Jun 11 16:00:34.003316 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:34.003290 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf4ff8955-6p9lz_981f6726-b941-49b0-87d1-717a87b8546b/copy-manifests/0.log" Jun 11 16:00:34.010559 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:34.010533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf4ff8955-6p9lz_981f6726-b941-49b0-87d1-717a87b8546b/manager/0.log" Jun 11 16:00:35.754422 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:35.754393 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5749f6bd48-9m2p6_be9178b1-fe70-42f3-b623-db69f0b85d12/authorino/0.log" Jun 11 16:00:36.481329 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:36.481299 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-krz2l_13c6e637-e346-4d57-b635-47251e2fb8cf/limitador/0.log" Jun 11 16:00:37.200287 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:37.200256 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fd5b6ff9-9ss45_ae6e2663-e58d-4b2e-ac51-e88269320d29/kube-auth-proxy/0.log" Jun 11 16:00:37.812351 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:37.812321 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d85cd65c-l7d8c_ef735c11-5522-481c-a960-49e0fbee63da/router/0.log" Jun 11 16:00:38.297524 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:38.297496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6hlxt_37728d98-d845-4780-a486-5ff3dbd839ba/storage-initializer/0.log" Jun 11 16:00:38.305468 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:38.305446 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6hlxt_37728d98-d845-4780-a486-5ff3dbd839ba/main/0.log" Jun 11 16:00:38.559998 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:38.559886 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f_a479b103-7dda-4cee-bc68-969b4637617d/storage-initializer/0.log" Jun 11 16:00:38.568202 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:38.568155 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477czqr5f_a479b103-7dda-4cee-bc68-969b4637617d/main/0.log" Jun 11 16:00:38.806825 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:38.806759 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-l5bjx_e2f88daa-828d-4fc9-b4a7-bf8203911a0b/storage-initializer/0.log" Jun 11 16:00:38.814344 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:38.814280 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-l5bjx_e2f88daa-828d-4fc9-b4a7-bf8203911a0b/main/0.log" Jun 11 16:00:44.324830 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.324790 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z99v2/must-gather-lf4q2"] Jun 11 16:00:44.325224 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.325193 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb2ad92a-6a14-43c5-9a22-cdbe719fd305" containerName="cleanup" Jun 11 16:00:44.325224 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.325206 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb2ad92a-6a14-43c5-9a22-cdbe719fd305" containerName="cleanup" Jun 11 16:00:44.325302 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.325284 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb2ad92a-6a14-43c5-9a22-cdbe719fd305" containerName="cleanup" Jun 11 16:00:44.328495 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.328477 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z99v2/must-gather-lf4q2" Jun 11 16:00:44.330714 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.330690 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z99v2\"/\"openshift-service-ca.crt\"" Jun 11 16:00:44.330915 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.330898 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-z99v2\"/\"default-dockercfg-5d86z\"" Jun 11 16:00:44.331482 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.331459 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-z99v2\"/\"kube-root-ca.crt\"" Jun 11 16:00:44.337311 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.337288 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z99v2/must-gather-lf4q2"] Jun 11 16:00:44.468979 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.468942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f464d126-b7ff-49d0-8a74-124c829d8f55-must-gather-output\") pod \"must-gather-lf4q2\" (UID: \"f464d126-b7ff-49d0-8a74-124c829d8f55\") " pod="openshift-must-gather-z99v2/must-gather-lf4q2" Jun 11 16:00:44.469150 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.469079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p576p\" (UniqueName: \"kubernetes.io/projected/f464d126-b7ff-49d0-8a74-124c829d8f55-kube-api-access-p576p\") pod \"must-gather-lf4q2\" (UID: \"f464d126-b7ff-49d0-8a74-124c829d8f55\") " pod="openshift-must-gather-z99v2/must-gather-lf4q2" Jun 11 16:00:44.569864 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.569824 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p576p\" (UniqueName: \"kubernetes.io/projected/f464d126-b7ff-49d0-8a74-124c829d8f55-kube-api-access-p576p\") pod \"must-gather-lf4q2\" (UID: \"f464d126-b7ff-49d0-8a74-124c829d8f55\") " pod="openshift-must-gather-z99v2/must-gather-lf4q2" Jun 11 16:00:44.570199 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.570175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f464d126-b7ff-49d0-8a74-124c829d8f55-must-gather-output\") pod \"must-gather-lf4q2\" (UID: \"f464d126-b7ff-49d0-8a74-124c829d8f55\") " pod="openshift-must-gather-z99v2/must-gather-lf4q2" Jun 11 16:00:44.570464 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.570443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f464d126-b7ff-49d0-8a74-124c829d8f55-must-gather-output\") pod \"must-gather-lf4q2\" (UID: \"f464d126-b7ff-49d0-8a74-124c829d8f55\") " pod="openshift-must-gather-z99v2/must-gather-lf4q2" Jun 11 16:00:44.578137 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.578078 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p576p\" (UniqueName: \"kubernetes.io/projected/f464d126-b7ff-49d0-8a74-124c829d8f55-kube-api-access-p576p\") pod \"must-gather-lf4q2\" (UID: \"f464d126-b7ff-49d0-8a74-124c829d8f55\") " pod="openshift-must-gather-z99v2/must-gather-lf4q2" Jun 11 16:00:44.638948 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.638926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z99v2/must-gather-lf4q2" Jun 11 16:00:44.773615 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:44.773590 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z99v2/must-gather-lf4q2"] Jun 11 16:00:44.776150 ip-10-0-142-103 kubenswrapper[2574]: W0611 16:00:44.776118 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf464d126_b7ff_49d0_8a74_124c829d8f55.slice/crio-ab6e2240362dc3c0ffc87e87dc51c906f60169e53b5d0cfcc926db512427f1fa WatchSource:0}: Error finding container ab6e2240362dc3c0ffc87e87dc51c906f60169e53b5d0cfcc926db512427f1fa: Status 404 returned error can't find the container with id ab6e2240362dc3c0ffc87e87dc51c906f60169e53b5d0cfcc926db512427f1fa Jun 11 16:00:45.345719 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:45.345686 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z99v2/must-gather-lf4q2" event={"ID":"f464d126-b7ff-49d0-8a74-124c829d8f55","Type":"ContainerStarted","Data":"ab6e2240362dc3c0ffc87e87dc51c906f60169e53b5d0cfcc926db512427f1fa"} Jun 11 16:00:46.355433 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:46.355391 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z99v2/must-gather-lf4q2" event={"ID":"f464d126-b7ff-49d0-8a74-124c829d8f55","Type":"ContainerStarted","Data":"a9bd466ef8736c3367ee18a63b2a6393917562a5253ac80e13dd929c40b08b4a"} Jun 11 16:00:46.355906 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:46.355445 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z99v2/must-gather-lf4q2" event={"ID":"f464d126-b7ff-49d0-8a74-124c829d8f55","Type":"ContainerStarted","Data":"dcdd2581732fa9169f73512a1b2a4cead75dc25c072a5b8c60341819c1d987c0"} Jun 11 16:00:46.373043 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:46.372999 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z99v2/must-gather-lf4q2" podStartSLOduration=1.426536952 podStartE2EDuration="2.372982807s" totalImagesPullingTime="946.445855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:00:46.371978427 +0000 UTC m=+2595.388129703" watchObservedRunningTime="2026-06-11 16:00:46.372982807 +0000 UTC m=+2595.389134082" Jun 11 16:00:47.738269 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:47.738236 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r8rd8_43b712bb-ebe7-41d5-96f7-6fe84649c4fc/global-pull-secret-syncer/0.log" Jun 11 16:00:47.833357 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:47.833328 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-csjrc_af89228b-8f74-46bf-a480-99c2e108ed8b/konnectivity-agent/0.log" Jun 11 16:00:47.947439 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:47.947410 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-103.ec2.internal_6433c8eee751c3d2240369462b2d4f86/haproxy/0.log" Jun 11 16:00:53.541612 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:53.541491 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5749f6bd48-9m2p6_be9178b1-fe70-42f3-b623-db69f0b85d12/authorino/0.log" Jun 11 16:00:53.897097 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:53.897065 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-krz2l_13c6e637-e346-4d57-b635-47251e2fb8cf/limitador/0.log" Jun 11 16:00:55.638692 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:55.638658 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf/alertmanager/0.log" Jun 11 16:00:55.669990 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:55.669887 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf/config-reloader/0.log" Jun 11 16:00:55.708115 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:55.708053 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf/kube-rbac-proxy-web/0.log" Jun 11 16:00:55.746921 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:55.746895 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf/kube-rbac-proxy/0.log" Jun 11 16:00:55.777120 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:55.777084 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf/kube-rbac-proxy-metric/0.log" Jun 11 16:00:55.803323 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:55.803193 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf/prom-label-proxy/0.log" Jun 11 16:00:55.835698 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:55.835672 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_3046e6a7-e53c-4e70-b9e0-ae5c9dd229bf/init-config-reloader/0.log" Jun 11 16:00:56.007623 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.007559 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5ff99777bd-vnhwf_aee30fb5-015d-4369-95f6-7a163e3cdb1d/metrics-server/0.log" Jun 11 16:00:56.263043 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.262935 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5ht2_ff833a9b-8ea3-4443-93f6-55d352977f46/node-exporter/0.log" Jun 11 16:00:56.288936 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.288907 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5ht2_ff833a9b-8ea3-4443-93f6-55d352977f46/kube-rbac-proxy/0.log" Jun 11 16:00:56.316154 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.316124 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l5ht2_ff833a9b-8ea3-4443-93f6-55d352977f46/init-textfile/0.log" Jun 11 16:00:56.441641 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.441597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75517f1-a9cc-498f-800b-d73d1d2bcde4/prometheus/0.log" Jun 11 16:00:56.467614 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.467571 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75517f1-a9cc-498f-800b-d73d1d2bcde4/config-reloader/0.log" Jun 11 16:00:56.497311 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.497279 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75517f1-a9cc-498f-800b-d73d1d2bcde4/thanos-sidecar/0.log" Jun 11 16:00:56.524041 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.523960 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75517f1-a9cc-498f-800b-d73d1d2bcde4/kube-rbac-proxy-web/0.log" Jun 11 16:00:56.551026 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.550990 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75517f1-a9cc-498f-800b-d73d1d2bcde4/kube-rbac-proxy/0.log" Jun 11 16:00:56.575099 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.575046 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75517f1-a9cc-498f-800b-d73d1d2bcde4/kube-rbac-proxy-thanos/0.log" Jun 11 16:00:56.599789 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.599745 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f75517f1-a9cc-498f-800b-d73d1d2bcde4/init-config-reloader/0.log" Jun 11 16:00:56.631735 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.631706 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gbbv9_66b484ea-bec9-4827-98ab-a4d55ea83c6e/prometheus-operator/0.log" Jun 11 16:00:56.659389 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.659356 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-gbbv9_66b484ea-bec9-4827-98ab-a4d55ea83c6e/kube-rbac-proxy/0.log" Jun 11 16:00:56.725405 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.725322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c6dcbf54d-95v5m_d3b0bd9f-22fb-478c-9412-680d67d8eef0/telemeter-client/0.log" Jun 11 16:00:56.751968 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.751940 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c6dcbf54d-95v5m_d3b0bd9f-22fb-478c-9412-680d67d8eef0/reload/0.log" Jun 11 16:00:56.778597 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:56.778530 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6c6dcbf54d-95v5m_d3b0bd9f-22fb-478c-9412-680d67d8eef0/kube-rbac-proxy/0.log" Jun 11 16:00:58.192057 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:58.192030 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-qhvqx_bb4152bf-a915-4c08-a81a-0d50c1da531c/networking-console-plugin/0.log" Jun 11 16:00:58.822560 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:58.822535 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/1.log" Jun 11 16:00:58.828410 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:58.828383 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-7scpf_f05089f8-0c8e-40f1-88bc-4081578a4e8b/console-operator/2.log" Jun 11 16:00:59.053063 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.053024 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc"] Jun 11 16:00:59.060369 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.060338 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.063796 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.063750 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc"] Jun 11 16:00:59.234029 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.233994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-proc\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.234571 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.234047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-lib-modules\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.234571 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.234103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-sys\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.234571 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.234164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzzbq\" (UniqueName: \"kubernetes.io/projected/e645539a-47b0-4fbc-a345-7f632d4f30f6-kube-api-access-lzzbq\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.234571 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.234259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-podres\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.335373 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.335327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-podres\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.335568 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.335459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-proc\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.335568 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.335498 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-lib-modules\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.335568 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.335525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-sys\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.335568 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.335556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzzbq\" (UniqueName: \"kubernetes.io/projected/e645539a-47b0-4fbc-a345-7f632d4f30f6-kube-api-access-lzzbq\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.336095 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.336066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-podres\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.336181 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.336149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-proc\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.336269 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.336248 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-lib-modules\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.336327 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.336304 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e645539a-47b0-4fbc-a345-7f632d4f30f6-sys\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.345620 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.345589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzzbq\" (UniqueName: \"kubernetes.io/projected/e645539a-47b0-4fbc-a345-7f632d4f30f6-kube-api-access-lzzbq\") pod \"perf-node-gather-daemonset-5swdc\" (UID: \"e645539a-47b0-4fbc-a345-7f632d4f30f6\") " pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.374957 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.374927 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:00:59.560035 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:00:59.558089 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc"] Jun 11 16:00:59.561859 ip-10-0-142-103 kubenswrapper[2574]: W0611 16:00:59.561804 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode645539a_47b0_4fbc_a345_7f632d4f30f6.slice/crio-64417bbaa0afcb5c74d423c69e2eb991dac6a01003e7fc63e9a43107f3615023 WatchSource:0}: Error finding container 64417bbaa0afcb5c74d423c69e2eb991dac6a01003e7fc63e9a43107f3615023: Status 404 returned error can't find the container with id 64417bbaa0afcb5c74d423c69e2eb991dac6a01003e7fc63e9a43107f3615023 Jun 11 16:01:00.464135 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:00.464092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" event={"ID":"e645539a-47b0-4fbc-a345-7f632d4f30f6","Type":"ContainerStarted","Data":"7221382273e8ad6d21773cb19c041ec1c0d6c9555ae2d0789ee15e3958d6e607"} Jun 11 16:01:00.464621 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:00.464197 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:01:00.464621 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:00.464224 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" event={"ID":"e645539a-47b0-4fbc-a345-7f632d4f30f6","Type":"ContainerStarted","Data":"64417bbaa0afcb5c74d423c69e2eb991dac6a01003e7fc63e9a43107f3615023"} Jun 11 16:01:00.481261 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:00.481201 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" podStartSLOduration=1.481161859 podStartE2EDuration="1.481161859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:01:00.481072883 +0000 UTC m=+2609.497224171" watchObservedRunningTime="2026-06-11 16:01:00.481161859 +0000 UTC m=+2609.497313194" Jun 11 16:01:01.438236 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:01.438211 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qq7h7_8221e5a8-dc66-4499-a9d7-ac824f4ce656/dns/0.log" Jun 11 16:01:01.461794 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:01.461741 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qq7h7_8221e5a8-dc66-4499-a9d7-ac824f4ce656/kube-rbac-proxy/0.log" Jun 11 16:01:01.513018 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:01.512984 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tk8cn_170b29a8-6051-453e-946c-6868a305f89a/dns-node-resolver/0.log" Jun 11 16:01:02.183209 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:02.183180 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nwhjd_905a9018-eb8e-41f3-9195-41afce5bc689/node-ca/0.log" Jun 11 16:01:03.373478 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:03.373453 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fd5b6ff9-9ss45_ae6e2663-e58d-4b2e-ac51-e88269320d29/kube-auth-proxy/0.log" Jun 11 16:01:03.632583 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:03.632504 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d85cd65c-l7d8c_ef735c11-5522-481c-a960-49e0fbee63da/router/0.log" Jun 11 16:01:04.343116 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:04.343085 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vdf75_c763b42a-b789-418f-947e-24f064579283/serve-healthcheck-canary/0.log" Jun 11 16:01:04.912321 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:04.912286 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-p7qgn_5996d218-4517-4fa2-bcbe-382499f0e7bf/insights-operator/0.log" Jun 11 16:01:04.912800 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:04.912783 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-p7qgn_5996d218-4517-4fa2-bcbe-382499f0e7bf/insights-operator/1.log" Jun 11 16:01:04.934552 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:04.934526 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44h45_b1c997db-cf65-453e-a84f-94c71b34f4ac/kube-rbac-proxy/0.log" Jun 11 16:01:04.960671 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:04.960643 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44h45_b1c997db-cf65-453e-a84f-94c71b34f4ac/exporter/0.log" Jun 11 16:01:04.983718 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:04.983688 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44h45_b1c997db-cf65-453e-a84f-94c71b34f4ac/extractor/0.log" Jun 11 16:01:06.482177 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:06.481650 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-z99v2/perf-node-gather-daemonset-5swdc" Jun 11 16:01:07.662164 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:07.662134 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686560-248ck_fb2ad92a-6a14-43c5-9a22-cdbe719fd305/cleanup/0.log" Jun 11 16:01:07.870286 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:07.870212 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf4ff8955-6p9lz_981f6726-b941-49b0-87d1-717a87b8546b/manager/0.log" Jun 11 16:01:07.894542 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:07.894447 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf4ff8955-6p9lz_981f6726-b941-49b0-87d1-717a87b8546b/copy-manifests/0.log" Jun 11 16:01:09.998647 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:09.998595 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c548d559f-58skz_1734a38a-8746-4c3f-86f4-c06a6366a610/manager/0.log" Jun 11 16:01:12.517176 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:12.517135 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fd5b6ff9-9ss45_ae6e2663-e58d-4b2e-ac51-e88269320d29/kube-auth-proxy/0.log" Jun 11 16:01:12.709254 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:12.709227 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d85cd65c-l7d8c_ef735c11-5522-481c-a960-49e0fbee63da/router/0.log" Jun 11 16:01:13.966287 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:13.966258 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fd5b6ff9-9ss45_ae6e2663-e58d-4b2e-ac51-e88269320d29/kube-auth-proxy/0.log" Jun 11 16:01:14.184072 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:14.184044 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d85cd65c-l7d8c_ef735c11-5522-481c-a960-49e0fbee63da/router/0.log" Jun 11 16:01:15.737941 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:15.737898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vlkp6_9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2/migrator/0.log" Jun 11 16:01:15.767468 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:15.767441 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-vlkp6_9ef2e6f3-04ee-4607-8c31-7e4ac964f2a2/graceful-termination/0.log" Jun 11 16:01:16.071181 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:16.071091 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-66fd5b6ff9-9ss45_ae6e2663-e58d-4b2e-ac51-e88269320d29/kube-auth-proxy/0.log" Jun 11 16:01:16.212635 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:16.212598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-scmcc_c84c4908-c457-4fdb-a5dc-6daf89c2a503/kube-storage-version-migrator-operator/1.log" Jun 11 16:01:16.214004 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:16.213964 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-scmcc_c84c4908-c457-4fdb-a5dc-6daf89c2a503/kube-storage-version-migrator-operator/0.log" Jun 11 16:01:16.270221 ip-10-0-142-103 kubenswrapper[2574]: I0611 16:01:16.270185 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6d85cd65c-l7d8c_ef735c11-5522-481c-a960-49e0fbee63da/router/0.log"