Jun 14 22:47:59.823063 ip-10-0-129-69 systemd[1]: Starting Kubernetes Kubelet... Jun 14 22:48:00.197760 ip-10-0-129-69 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:48:00.197760 ip-10-0-129-69 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 14 22:48:00.197760 ip-10-0-129-69 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:48:00.197760 ip-10-0-129-69 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 14 22:48:00.197760 ip-10-0-129-69 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 14 22:48:00.198690 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.198594 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 14 22:48:00.203919 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203897 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:48:00.203919 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203914 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:48:00.203919 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203918 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:48:00.203919 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203923 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:48:00.203919 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203928 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203931 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203934 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203938 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203942 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203945 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203948 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203951 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203953 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203956 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203959 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203961 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203964 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203967 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203969 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203972 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203974 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203977 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203980 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203983 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:48:00.204123 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203985 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203988 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203991 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203993 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203996 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.203999 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204001 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204009 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204012 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204014 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204018 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204020 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204023 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204026 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204029 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204032 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204034 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204037 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204040 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204043 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:48:00.204604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204045 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204048 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204050 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204053 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204056 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204058 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204060 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204063 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204066 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204070 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204075 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204078 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204081 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204084 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204087 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204090 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204092 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204095 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204098 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:48:00.205114 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204100 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204103 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204105 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204108 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204111 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204114 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204119 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204122 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204125 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204129 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204132 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204135 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204139 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204142 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204144 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204147 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204149 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204152 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204155 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:48:00.205571 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204157 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204160 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204163 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204166 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204168 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204171 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204173 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204176 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204178 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204181 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204183 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204186 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204188 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204191 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204194 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204196 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204199 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204932 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204940 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204945 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:48:00.206062 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204948 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204951 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204954 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204958 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204960 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204964 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204966 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204969 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204972 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204975 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204977 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204980 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204982 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204985 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204988 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204991 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204993 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204996 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.204998 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205001 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:48:00.206552 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205004 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205007 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205011 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205015 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205018 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205021 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205024 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205027 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205030 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205032 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205035 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205038 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205041 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205044 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205046 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205049 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205052 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205055 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205057 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205060 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:48:00.207100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205063 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205065 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205068 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205070 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205073 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205076 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205078 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205082 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205084 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205087 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205089 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205093 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205098 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205101 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205104 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205107 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205110 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205112 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205115 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:48:00.207583 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205119 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205124 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205127 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205130 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205134 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205137 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205140 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205143 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205146 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205148 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205151 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205154 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205157 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205160 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205163 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205166 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205168 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205171 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205174 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205177 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:48:00.208107 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205179 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205182 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205185 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205188 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205190 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205192 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205195 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205197 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205201 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205204 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205206 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205209 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205211 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205214 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205216 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205219 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205222 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205615 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205620 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205623 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:48:00.208591 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205626 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205629 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205631 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205634 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205637 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205639 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205642 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205645 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205647 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205650 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205653 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205655 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205657 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205660 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205663 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205666 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205668 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205671 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205673 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205676 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:48:00.209100 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205679 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205682 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205684 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205687 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205693 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205696 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205698 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205701 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205705 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205707 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205710 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205713 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205715 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205718 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205720 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205723 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205726 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205728 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205731 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:48:00.209582 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205733 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205736 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205738 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205757 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205762 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205765 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205768 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205771 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205774 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205777 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205779 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205782 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205785 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205788 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205790 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205793 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205796 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205799 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205802 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:48:00.210056 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205805 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205807 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205810 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205813 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205815 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205818 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205820 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205823 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205825 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205828 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205830 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205833 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205835 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205839 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205841 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205844 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205846 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205849 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205851 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:48:00.210529 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205854 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205857 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205859 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205862 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205865 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205869 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205872 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205875 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205878 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205881 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205884 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205888 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205890 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205893 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205895 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205898 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205900 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205903 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.205905 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.205976 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 14 22:48:00.211018 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.205984 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.205991 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.205996 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206000 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206003 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206008 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206012 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206015 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206018 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206021 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206024 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206027 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206030 2568 flags.go:64] FLAG: --cgroup-root="" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206033 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206036 2568 flags.go:64] FLAG: --client-ca-file="" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206039 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206042 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206047 2568 flags.go:64] FLAG: --cluster-domain="" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206050 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206053 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206057 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206060 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206064 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 14 22:48:00.211495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206069 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206072 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206076 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206079 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206082 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206085 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206088 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206091 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206095 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206098 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206101 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206105 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206108 2568 flags.go:64] FLAG: --enable-server="true" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206111 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206116 2568 flags.go:64] FLAG: --event-burst="100" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206119 2568 flags.go:64] FLAG: --event-qps="50" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206122 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206125 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206127 2568 flags.go:64] FLAG: --eviction-hard="" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206131 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206134 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206137 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206140 2568 flags.go:64] FLAG: --eviction-soft="" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206143 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206146 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 14 22:48:00.212068 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206149 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206152 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206157 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206160 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206163 2568 flags.go:64] FLAG: --feature-gates="" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206171 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206174 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206178 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206181 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206184 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206187 2568 flags.go:64] FLAG: --help="false" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206190 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206194 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206197 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206199 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206203 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206206 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206209 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206212 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206215 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206218 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206220 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206223 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206226 2568 flags.go:64] FLAG: --kube-reserved="" Jun 14 22:48:00.212735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206229 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206232 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206235 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206237 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206240 2568 flags.go:64] FLAG: --lock-file="" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206243 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206246 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206249 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206254 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206257 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206261 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206264 2568 flags.go:64] FLAG: --logging-format="text" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206267 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206270 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206273 2568 flags.go:64] FLAG: --manifest-url="" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206276 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206281 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206284 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206288 2568 flags.go:64] FLAG: --max-pods="110" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206291 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206294 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206297 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206300 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206303 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206306 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 14 22:48:00.213352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206309 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206316 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206319 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206322 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206325 2568 flags.go:64] FLAG: --pod-cidr="" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206328 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206334 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206337 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206340 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206343 2568 flags.go:64] FLAG: --port="10250" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206345 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206348 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-007823ac1aa522347" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206351 2568 flags.go:64] FLAG: --qos-reserved="" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206354 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206357 2568 flags.go:64] FLAG: --register-node="true" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206360 2568 flags.go:64] FLAG: --register-with-taints="" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206364 2568 flags.go:64] FLAG: --registry-burst="10" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206369 2568 flags.go:64] FLAG: --registry-qps="5" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206372 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206375 2568 flags.go:64] FLAG: --reserved-memory="" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206379 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206390 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206394 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206397 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206400 2568 flags.go:64] FLAG: --runonce="false" Jun 14 22:48:00.213977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206403 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206406 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206409 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206412 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206415 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206418 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206421 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206424 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206427 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206430 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206432 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206435 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206438 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206441 2568 flags.go:64] FLAG: --system-cgroups="" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206444 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206450 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206453 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206456 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206460 2568 flags.go:64] FLAG: --tls-min-version="" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206463 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206466 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206469 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206471 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206474 2568 flags.go:64] FLAG: --v="2" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206480 2568 flags.go:64] FLAG: --version="false" Jun 14 22:48:00.214594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206484 2568 flags.go:64] FLAG: --vmodule="" Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206488 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.206491 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206608 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206612 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206615 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206619 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206622 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206625 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206628 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206630 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206633 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206636 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206638 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206641 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206644 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206648 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206652 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206655 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:48:00.215218 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206657 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206660 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206663 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206665 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206668 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206671 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206673 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206676 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206679 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206681 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206684 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206686 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206690 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206693 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206696 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206699 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206701 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206706 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206709 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206711 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:48:00.215685 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206714 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206716 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206719 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206722 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206725 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206727 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206730 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206733 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206736 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206739 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206756 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206759 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206761 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206764 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206767 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206769 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206772 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206775 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206778 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:48:00.216190 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206781 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206783 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206786 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206789 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206792 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206797 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206800 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206802 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206805 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206808 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206812 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206815 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206818 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206821 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206824 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206826 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206829 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206832 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206834 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206837 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:48:00.216690 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206840 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206844 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206847 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206850 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206852 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206855 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206857 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206860 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206863 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206865 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206869 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206873 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206876 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206879 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206882 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206885 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206887 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206891 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206894 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:48:00.217230 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206896 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206899 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206902 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206906 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.206908 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.207474 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.214212 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.214322 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.215154 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.215161 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215219 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215225 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215229 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215232 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:48:00.217689 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215235 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215238 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215241 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215243 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215246 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215249 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215251 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215254 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215257 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215259 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215262 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215264 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215267 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215270 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215273 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215275 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215278 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215282 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215284 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215287 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:48:00.218066 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215291 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215294 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215297 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215299 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215302 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215306 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215309 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215311 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215314 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215316 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215321 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215325 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215328 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215331 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215333 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215337 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215340 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215343 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215346 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215348 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:48:00.218566 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215351 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215354 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215357 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215359 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215362 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215365 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215367 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215370 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215373 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215377 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215381 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215383 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215386 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215389 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215392 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215395 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215398 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215400 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215403 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:48:00.219073 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215405 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215408 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215410 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215413 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215415 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215418 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215420 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215423 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215425 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215428 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215431 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215433 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215436 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215439 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215441 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215443 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215446 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215448 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215451 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215454 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:48:00.219521 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215457 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215459 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215462 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215465 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215467 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215470 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215473 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215476 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215480 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215483 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215486 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215489 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215492 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215495 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215497 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:48:00.220032 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215500 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.215505 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215632 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215637 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215640 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215642 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215645 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215648 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215650 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215653 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215656 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215660 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215663 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215667 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 14 22:48:00.220400 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215670 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215673 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215675 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215678 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215681 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215684 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215687 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215689 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215692 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215695 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215698 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215702 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215705 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215707 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215709 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215712 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215714 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215717 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215719 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215722 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 14 22:48:00.220760 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215724 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215727 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215729 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215732 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215735 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215737 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215750 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215753 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215756 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215759 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215761 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215765 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215768 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215771 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215774 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215776 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215779 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215781 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215784 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215787 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 14 22:48:00.221250 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215789 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215792 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215795 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215797 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215801 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215803 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215806 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215808 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215811 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215814 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215816 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215819 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215821 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215824 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215826 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215829 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215832 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215834 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215836 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215839 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 14 22:48:00.221727 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215841 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215844 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215846 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215849 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215852 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215855 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215859 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215862 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215864 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215867 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215870 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215872 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215875 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215878 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215881 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215884 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215886 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215889 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215892 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 14 22:48:00.222225 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215894 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215897 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215899 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215902 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215905 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215907 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215910 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:00.215913 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.215918 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.216029 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.218549 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.219716 2568 server.go:1019] "Starting client certificate rotation" Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.219814 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 22:48:00.222707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.219844 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 14 22:48:00.223049 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.222062 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 22:48:00.225916 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.225876 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 14 22:48:00.236489 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.236463 2568 log.go:25] "Validated CRI v1 runtime API" Jun 14 22:48:00.239367 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.239348 2568 log.go:25] "Validated CRI v1 image API" Jun 14 22:48:00.240228 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.240213 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 14 22:48:00.243683 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.243664 2568 fs.go:135] Filesystem UUIDs: map[68d32cd1-0b05-448c-bbb7-fd60ccb860df:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8e5857c8-b4ce-48ec-a55a-94d6a7672de4:/dev/nvme0n1p3] Jun 14 22:48:00.243769 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.243682 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 14 22:48:00.248543 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.248523 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 22:48:00.249896 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.249762 2568 manager.go:216] Machine: {Timestamp:2026-06-14 22:48:00.24767104 +0000 UTC m=+0.314053791 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099068 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c9140f38fd1294ef31efc742c96c4 SystemUUID:ec2c9140-f38f-d129-4ef3-1efc742c96c4 BootID:1fe255ee-e6d8-4cb1-b073-7a1829c63072 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:52:5f:39:67:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:52:5f:39:67:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:a2:d8:13:81:38 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 14 22:48:00.249896 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.249888 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 14 22:48:00.250021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.249978 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 14 22:48:00.252726 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.252690 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 14 22:48:00.252888 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.252731 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-69.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 14 22:48:00.253892 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.253881 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 14 22:48:00.253931 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.253895 2568 container_manager_linux.go:309] "Creating device plugin manager" Jun 14 22:48:00.253931 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.253903 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 22:48:00.254579 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.254568 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 14 22:48:00.255766 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.255738 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 14 22:48:00.260365 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.260353 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 14 22:48:00.260497 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.260487 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 14 22:48:00.260528 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.260520 2568 kubelet.go:486] "Attempting to sync node with API server" Jun 14 22:48:00.260558 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.260540 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 14 22:48:00.260558 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.260552 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 14 22:48:00.260614 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.260562 2568 kubelet.go:398] "Adding apiserver pod source" Jun 14 22:48:00.260614 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.260599 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 14 22:48:00.261005 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.260991 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 22:48:00.261048 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.261015 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 14 22:48:00.269274 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.269253 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-69.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 14 22:48:00.269350 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.269282 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 14 22:48:00.272919 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.272904 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-npgrj" Jun 14 22:48:00.274986 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.274961 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 14 22:48:00.276348 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.276336 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 14 22:48:00.276411 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.276366 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 14 22:48:00.276525 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.276515 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 14 22:48:00.276575 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.276530 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 14 22:48:00.276575 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.276536 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 14 22:48:00.276575 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.276541 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 14 22:48:00.276575 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.276549 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 14 22:48:00.276575 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.276555 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 14 22:48:00.277032 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.277023 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 14 22:48:00.277064 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.277032 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 14 22:48:00.277064 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.277041 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 14 22:48:00.277064 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.277046 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 14 22:48:00.277064 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.277054 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 14 22:48:00.277064 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.277062 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 14 22:48:00.277730 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.277719 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 14 22:48:00.277730 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.277728 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 14 22:48:00.278197 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.278183 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-npgrj" Jun 14 22:48:00.279406 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.279390 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-69.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 14 22:48:00.280941 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.280927 2568 server.go:1268] "Started kubelet" Jun 14 22:48:00.281155 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.281109 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 14 22:48:00.281212 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.281171 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 14 22:48:00.281212 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.281203 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 14 22:48:00.281857 ip-10-0-129-69 systemd[1]: Started Kubernetes Kubelet. Jun 14 22:48:00.283130 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.283115 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 14 22:48:00.284928 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.284326 2568 server.go:310] "Adding debug handlers to kubelet server" Jun 14 22:48:00.288526 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.288502 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 14 22:48:00.288899 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.288886 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 14 22:48:00.288899 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.288894 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 14 22:48:00.289015 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.288962 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:00.289400 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.289383 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 14 22:48:00.289400 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.289384 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 14 22:48:00.289532 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.289408 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 14 22:48:00.289532 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.289498 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 14 22:48:00.289532 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.289506 2568 reconciler.go:29] "Reconciler: start to sync state" Jun 14 22:48:00.289995 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.289980 2568 factory.go:153] Registering CRI-O factory Jun 14 22:48:00.290073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.289999 2568 factory.go:223] Registration of the crio container factory successfully Jun 14 22:48:00.290073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.290051 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 14 22:48:00.290073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.290060 2568 factory.go:55] Registering systemd factory Jun 14 22:48:00.290073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.290068 2568 factory.go:223] Registration of the systemd container factory successfully Jun 14 22:48:00.290208 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.290089 2568 factory.go:103] Registering Raw factory Jun 14 22:48:00.290208 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.290104 2568 manager.go:1196] Started watching for new ooms in manager Jun 14 22:48:00.290447 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.290436 2568 manager.go:349] Starting recovery of all containers Jun 14 22:48:00.294335 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.294313 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:48:00.299561 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.299539 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-69.ec2.internal\" not found" node="ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.300996 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.300977 2568 manager.go:354] Recovery completed Jun 14 22:48:00.302513 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.302492 2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 14 22:48:00.305328 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.305316 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:48:00.307071 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.307054 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:48:00.307132 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.307088 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:48:00.307132 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.307099 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:48:00.307631 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.307616 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 14 22:48:00.307631 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.307629 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:48:00.307737 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.307629 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 14 22:48:00.307737 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.307722 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 14 22:48:00.308466 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.308439 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:48:00.308466 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.308466 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:48:00.308527 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.308476 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:48:00.309933 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.309922 2568 policy_none.go:49] "None policy: Start" Jun 14 22:48:00.309977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.309937 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 14 22:48:00.309977 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.309947 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 14 22:48:00.311848 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.311835 2568 policy_none.go:47] "Start" Jun 14 22:48:00.352291 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.352270 2568 manager.go:337] "Starting Device Plugin manager" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.352317 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.352330 2568 server.go:87] "Starting device plugin registration server" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.352603 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.352617 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.352716 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.352815 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.352825 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.353449 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.353506 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.356174 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.357418 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.357452 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.357473 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.357505 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 14 22:48:00.371129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.359510 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:48:00.453790 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.453699 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:48:00.455003 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.454984 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:48:00.455117 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.455018 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:48:00.455117 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.455029 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:48:00.455117 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.455053 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.458583 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.458564 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal"] Jun 14 22:48:00.458664 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.458624 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:48:00.459388 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.459372 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:48:00.459468 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.459398 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:48:00.459468 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.459407 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:48:00.461539 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.461522 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:48:00.461663 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.461640 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.461710 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.461677 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:48:00.462188 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.462172 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:48:00.462295 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.462200 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:48:00.462295 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.462215 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:48:00.462295 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.462270 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:48:00.462451 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.462302 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:48:00.462451 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.462316 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:48:00.464008 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.463987 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.464008 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.464005 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-69.ec2.internal\": node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:00.464359 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.464344 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.464399 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.464378 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 14 22:48:00.465070 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.465054 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientMemory" Jun 14 22:48:00.465154 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.465078 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasNoDiskPressure" Jun 14 22:48:00.465154 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.465093 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeHasSufficientPID" Jun 14 22:48:00.478175 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.478154 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:00.491331 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.491308 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.491439 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.491332 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.491439 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.491352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6cc1eeeda5c676493db83fa5936c2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-69.ec2.internal\" (UID: \"e6cc1eeeda5c676493db83fa5936c2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.491554 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.491517 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-69.ec2.internal\" not found" node="ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.495899 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.495884 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-69.ec2.internal\" not found" node="ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.578413 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.578380 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:00.592095 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.592073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.592210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.592099 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.592210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.592118 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6cc1eeeda5c676493db83fa5936c2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-69.ec2.internal\" (UID: \"e6cc1eeeda5c676493db83fa5936c2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.592210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.592161 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e6cc1eeeda5c676493db83fa5936c2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-129-69.ec2.internal\" (UID: \"e6cc1eeeda5c676493db83fa5936c2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.592210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.592173 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.592210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.592187 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23273554850e38b11c948ea91c43bdb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal\" (UID: \"23273554850e38b11c948ea91c43bdb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.678832 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.678792 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:00.779617 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.779540 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:00.793874 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.793847 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.799066 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:00.799039 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 14 22:48:00.880063 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.880025 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:00.980564 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:00.980539 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:01.081116 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:01.081039 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:01.181626 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:01.181597 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:01.219067 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.219042 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 14 22:48:01.219618 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.219206 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 22:48:01.219618 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.219215 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 14 22:48:01.282158 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:01.282131 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:01.283236 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.283198 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-13 22:43:00 +0000 UTC" deadline="2027-12-25 07:39:33.058770526 +0000 UTC" Jun 14 22:48:01.283296 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.283239 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13400h51m31.775537419s" Jun 14 22:48:01.339594 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:01.339529 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6cc1eeeda5c676493db83fa5936c2f7.slice/crio-2a6dea5edf1ede0e4f38f66f6cebf007d135334372fd12a784369a0f71d0889f WatchSource:0}: Error finding container 2a6dea5edf1ede0e4f38f66f6cebf007d135334372fd12a784369a0f71d0889f: Status 404 returned error can't find the container with id 2a6dea5edf1ede0e4f38f66f6cebf007d135334372fd12a784369a0f71d0889f Jun 14 22:48:01.339969 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:01.339949 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23273554850e38b11c948ea91c43bdb5.slice/crio-e4d88f412799565d57bea3680084af144b40404b161fea5e4a68ca5667c84d1c WatchSource:0}: Error finding container e4d88f412799565d57bea3680084af144b40404b161fea5e4a68ca5667c84d1c: Status 404 returned error can't find the container with id e4d88f412799565d57bea3680084af144b40404b161fea5e4a68ca5667c84d1c Jun 14 22:48:01.343988 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.343966 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:48:01.360357 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.360308 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" event={"ID":"23273554850e38b11c948ea91c43bdb5","Type":"ContainerStarted","Data":"e4d88f412799565d57bea3680084af144b40404b161fea5e4a68ca5667c84d1c"} Jun 14 22:48:01.361276 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.361252 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" event={"ID":"e6cc1eeeda5c676493db83fa5936c2f7","Type":"ContainerStarted","Data":"2a6dea5edf1ede0e4f38f66f6cebf007d135334372fd12a784369a0f71d0889f"} Jun 14 22:48:01.382435 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:01.382409 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:01.482943 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:01.482918 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:01.583400 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:01.583373 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-69.ec2.internal\" not found" Jun 14 22:48:01.635844 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.635760 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:48:01.645523 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.645500 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:48:01.689292 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.689271 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" Jun 14 22:48:01.699189 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.699171 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 22:48:01.700222 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.700205 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" Jun 14 22:48:01.708271 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:01.708251 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 14 22:48:02.262059 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.262028 2568 apiserver.go:52] "Watching apiserver" Jun 14 22:48:02.271112 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.271078 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 14 22:48:02.271909 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.271881 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n","openshift-dns/node-resolver-4nh86","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal","openshift-multus/multus-7f6gp","openshift-multus/multus-additional-cni-plugins-fbkbb","openshift-multus/network-metrics-daemon-pwqsb","openshift-network-operator/iptables-alerter-9xd5f","kube-system/konnectivity-agent-vzqdb","kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal","openshift-cluster-node-tuning-operator/tuned-h6k5d","openshift-image-registry/node-ca-pwsbh","openshift-network-diagnostics/network-check-target-xdhpw","openshift-ovn-kubernetes/ovnkube-node-wb65p","kube-system/global-pull-secret-syncer-pjvgp"] Jun 14 22:48:02.274416 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.274378 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.276635 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.276607 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.276772 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.276720 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:48:02.276875 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.276732 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7rccg\"" Jun 14 22:48:02.276975 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.276736 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 14 22:48:02.277212 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.277196 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 14 22:48:02.278872 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.278821 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.278965 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.278884 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:02.279581 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.279270 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 14 22:48:02.279581 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.279359 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zf6tz\"" Jun 14 22:48:02.279581 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.279402 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 14 22:48:02.279581 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.279423 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 14 22:48:02.279581 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.279481 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 14 22:48:02.280223 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.280193 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 14 22:48:02.280327 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.280197 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 14 22:48:02.281309 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.281117 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.283139 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.283122 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 14 22:48:02.283371 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.283350 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6snj\"" Jun 14 22:48:02.283371 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.283364 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 14 22:48:02.283520 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.283387 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 14 22:48:02.283520 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.283445 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.283638 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.283618 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 14 22:48:02.285569 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.285550 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 14 22:48:02.285669 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.285550 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s88pl\"" Jun 14 22:48:02.285669 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.285552 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 14 22:48:02.287618 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.287596 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:02.287704 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.287667 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:02.289342 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.289324 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 14 22:48:02.290026 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.289984 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:02.292049 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.292031 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 14 22:48:02.292256 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.292235 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 14 22:48:02.292332 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.292237 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wvpl7\"" Jun 14 22:48:02.292561 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.292546 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.294571 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.294553 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wrnvf\"" Jun 14 22:48:02.295352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.294797 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 14 22:48:02.295352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.294828 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 14 22:48:02.295352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.294994 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.295352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.295070 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 14 22:48:02.297048 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.297029 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 14 22:48:02.297143 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.297034 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 14 22:48:02.297143 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.297090 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5ls4d\"" Jun 14 22:48:02.297412 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.297392 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.298184 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.298161 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 14 22:48:02.299530 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.299510 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:48:02.299619 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.299520 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kp258\"" Jun 14 22:48:02.299619 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.299564 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 14 22:48:02.300443 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.300427 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.301852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.301831 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-etc-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.301963 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.301872 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-multus-certs\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.301963 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.301901 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af3293c7-c2f1-4760-bca0-bb88ac81481a-agent-certs\") pod \"konnectivity-agent-vzqdb\" (UID: \"af3293c7-c2f1-4760-bca0-bb88ac81481a\") " pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:02.301963 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.301925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-systemd-units\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.301963 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.301954 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-conf-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.302186 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.301982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-run-netns\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.302186 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302011 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-k8s-cni-cncf-io\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.302186 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-cni-multus\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.302186 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302149 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckqdt\" (UniqueName: \"kubernetes.io/projected/1a75dc5e-d60a-432b-a1a9-4639f77052c6-kube-api-access-ckqdt\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.302392 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec01c46e-e265-407f-bce2-630e457dd40f-dbus\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.302392 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302276 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.302392 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302310 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-system-cni-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.302392 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a75dc5e-d60a-432b-a1a9-4639f77052c6-cni-binary-copy\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.302392 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302378 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.302630 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.302630 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4v84\" (UniqueName: \"kubernetes.io/projected/af9ceced-b4ae-40c1-b7c0-77966f7a505d-kube-api-access-z4v84\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:02.302630 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-ovnkube-script-lib\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.302630 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af3293c7-c2f1-4760-bca0-bb88ac81481a-konnectivity-ca\") pod \"konnectivity-agent-vzqdb\" (UID: \"af3293c7-c2f1-4760-bca0-bb88ac81481a\") " pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:02.302630 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-ovn\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.302630 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302564 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-os-release\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.302630 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:02.302630 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-kubelet\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302656 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-netns\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302687 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7zxk\" (UniqueName: \"kubernetes.io/projected/f1b464e1-b467-43d3-8ff1-17975126be5a-kube-api-access-g7zxk\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec01c46e-e265-407f-bce2-630e457dd40f-kubelet-config\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302763 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d089068-2e48-485b-98a3-045a0f648de5-ovn-node-metrics-cert\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302779 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ftcht\"" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-cni-bin\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302824 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-system-cni-dir\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302856 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-node-log\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302881 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-log-socket\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-socket-dir-parent\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-hostroot\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302943 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.302969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk6xk\" (UniqueName: \"kubernetes.io/projected/8d089068-2e48-485b-98a3-045a0f648de5-kube-api-access-kk6xk\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303079 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303066 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b128a0fc-7187-4828-a0f7-d704cadb6f7d-iptables-alerter-script\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303153 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-env-overrides\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-cni-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303260 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-cni-bin\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-ovnkube-config\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303343 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-cnibin\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-os-release\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-etc-kubernetes\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-cnibin\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303493 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-cni-netd\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303524 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-slash\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-systemd\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303568 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-var-lib-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303658 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-daemon-config\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.303758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.304567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-run-ovn-kubernetes\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.304567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-kubelet\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.304567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303820 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 14 22:48:02.304567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303833 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.304567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kchf5\" (UniqueName: \"kubernetes.io/projected/b128a0fc-7187-4828-a0f7-d704cadb6f7d-kube-api-access-kchf5\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.304567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.303901 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b128a0fc-7187-4828-a0f7-d704cadb6f7d-host-slash\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.304862 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.304779 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:02.304912 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.304856 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:02.318424 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.318400 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7kgtn" Jun 14 22:48:02.323187 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.323167 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7kgtn" Jun 14 22:48:02.391268 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.391240 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 14 22:48:02.404696 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404664 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-system-cni-dir\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysconfig\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404731 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0127d674-0a6e-423a-a8d8-154b09d0c9b3-tmp\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-node-log\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404795 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-log-socket\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-system-cni-dir\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404811 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-socket-dir-parent\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-hostroot\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk6xk\" (UniqueName: \"kubernetes.io/projected/8d089068-2e48-485b-98a3-045a0f648de5-kube-api-access-kk6xk\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404854 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-node-log\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b128a0fc-7187-4828-a0f7-d704cadb6f7d-iptables-alerter-script\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.404881 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404859 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-log-socket\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-lib-modules\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404918 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-hostroot\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-socket-dir-parent\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.404956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-env-overrides\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405011 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405030 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-cni-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405121 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-cni-bin\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405171 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-cni-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-ovnkube-config\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405207 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-cnibin\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405224 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-os-release\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405239 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-cni-bin\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405245 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-etc-kubernetes\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405283 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-etc-kubernetes\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405289 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-cnibin\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.405435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405318 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-cnibin\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405339 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-cnibin\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405347 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-tuned\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405371 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-cni-netd\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405397 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-os-release\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405410 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-env-overrides\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-slash\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-systemd\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-cni-netd\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405466 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b128a0fc-7187-4828-a0f7-d704cadb6f7d-iptables-alerter-script\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405496 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-var-lib-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405505 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-slash\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405568 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-systemd\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-var-lib-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh7cf\" (UniqueName: \"kubernetes.io/projected/e79e59cc-8c51-48b5-83cb-d0636f606a00-kube-api-access-lh7cf\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405601 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.406288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-daemon-config\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405697 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-device-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405734 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-ovnkube-config\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-run-ovn-kubernetes\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405781 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-kubelet\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405798 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405806 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-run-ovn-kubernetes\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kchf5\" (UniqueName: \"kubernetes.io/projected/b128a0fc-7187-4828-a0f7-d704cadb6f7d-kube-api-access-kchf5\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405835 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysctl-d\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405840 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-kubelet\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b128a0fc-7187-4828-a0f7-d704cadb6f7d-host-slash\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e79e59cc-8c51-48b5-83cb-d0636f606a00-tmp-dir\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405977 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-kubernetes\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405982 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.405992 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-systemd\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b128a0fc-7187-4828-a0f7-d704cadb6f7d-host-slash\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.407042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-var-lib-kubelet\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-etc-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406204 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-daemon-config\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406238 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-etc-openvswitch\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406590 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-multus-certs\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af3293c7-c2f1-4760-bca0-bb88ac81481a-agent-certs\") pod \"konnectivity-agent-vzqdb\" (UID: \"af3293c7-c2f1-4760-bca0-bb88ac81481a\") " pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406634 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-systemd-units\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-conf-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-socket-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-host\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406711 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-multus-certs\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406719 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-multus-conf-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406700 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-systemd-units\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406725 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-run-netns\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406778 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-run-netns\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406804 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-k8s-cni-cncf-io\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.407859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406829 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-cni-multus\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406831 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-k8s-cni-cncf-io\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406877 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-cni-multus\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406913 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckqdt\" (UniqueName: \"kubernetes.io/projected/1a75dc5e-d60a-432b-a1a9-4639f77052c6-kube-api-access-ckqdt\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec01c46e-e265-407f-bce2-630e457dd40f-dbus\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.406994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-registration-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407014 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-system-cni-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a75dc5e-d60a-432b-a1a9-4639f77052c6-cni-binary-copy\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407128 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs98s\" (UniqueName: \"kubernetes.io/projected/03ed58c1-e0de-4014-aa24-2b69fe29c05c-kube-api-access-bs98s\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407143 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ec01c46e-e265-407f-bce2-630e457dd40f-dbus\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-modprobe-d\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407174 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-run\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407207 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-sys\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.408621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407215 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-system-cni-dir\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4tvn\" (UniqueName: \"kubernetes.io/projected/4421799d-5cac-4b15-b643-b2e6f184a1b7-kube-api-access-x4tvn\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4v84\" (UniqueName: \"kubernetes.io/projected/af9ceced-b4ae-40c1-b7c0-77966f7a505d-kube-api-access-z4v84\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.407314 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.407398 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret podName:ec01c46e-e265-407f-bce2-630e457dd40f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:02.907360062 +0000 UTC m=+2.973742796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret") pod "global-pull-secret-syncer-pjvgp" (UID: "ec01c46e-e265-407f-bce2-630e457dd40f") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-ovnkube-script-lib\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e79e59cc-8c51-48b5-83cb-d0636f606a00-hosts-file\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4421799d-5cac-4b15-b643-b2e6f184a1b7-host\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407622 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af3293c7-c2f1-4760-bca0-bb88ac81481a-konnectivity-ca\") pod \"konnectivity-agent-vzqdb\" (UID: \"af3293c7-c2f1-4760-bca0-bb88ac81481a\") " pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407644 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-ovn\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407666 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1a75dc5e-d60a-432b-a1a9-4639f77052c6-cni-binary-copy\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407669 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-os-release\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407738 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1b464e1-b467-43d3-8ff1-17975126be5a-os-release\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407803 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-sys-fs\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407828 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7br4b\" (UniqueName: \"kubernetes.io/projected/0127d674-0a6e-423a-a8d8-154b09d0c9b3-kube-api-access-7br4b\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.409248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4421799d-5cac-4b15-b643-b2e6f184a1b7-serviceca\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407915 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8d089068-2e48-485b-98a3-045a0f648de5-ovnkube-script-lib\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-kubelet\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-netns\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-host-kubelet\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.407996 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7zxk\" (UniqueName: \"kubernetes.io/projected/f1b464e1-b467-43d3-8ff1-17975126be5a-kube-api-access-g7zxk\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408017 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8d089068-2e48-485b-98a3-045a0f648de5-run-ovn\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408017 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-cni-binary-copy\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec01c46e-e265-407f-bce2-630e457dd40f-kubelet-config\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408073 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ec01c46e-e265-407f-bce2-630e457dd40f-kubelet-config\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408091 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-run-netns\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408146 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysctl-conf\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.408178 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408177 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d089068-2e48-485b-98a3-045a0f648de5-ovn-node-metrics-cert\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408229 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/af3293c7-c2f1-4760-bca0-bb88ac81481a-konnectivity-ca\") pod \"konnectivity-agent-vzqdb\" (UID: \"af3293c7-c2f1-4760-bca0-bb88ac81481a\") " pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-cni-bin\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.409982 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.408376 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:48:02.908357129 +0000 UTC m=+2.974739860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:02.410787 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408396 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1a75dc5e-d60a-432b-a1a9-4639f77052c6-host-var-lib-cni-bin\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.410787 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.408437 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1b464e1-b467-43d3-8ff1-17975126be5a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.410787 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.410477 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/af3293c7-c2f1-4760-bca0-bb88ac81481a-agent-certs\") pod \"konnectivity-agent-vzqdb\" (UID: \"af3293c7-c2f1-4760-bca0-bb88ac81481a\") " pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:02.410787 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.410546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8d089068-2e48-485b-98a3-045a0f648de5-ovn-node-metrics-cert\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.413799 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.413778 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kchf5\" (UniqueName: \"kubernetes.io/projected/b128a0fc-7187-4828-a0f7-d704cadb6f7d-kube-api-access-kchf5\") pod \"iptables-alerter-9xd5f\" (UID: \"b128a0fc-7187-4828-a0f7-d704cadb6f7d\") " pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.414293 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.414238 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk6xk\" (UniqueName: \"kubernetes.io/projected/8d089068-2e48-485b-98a3-045a0f648de5-kube-api-access-kk6xk\") pod \"ovnkube-node-wb65p\" (UID: \"8d089068-2e48-485b-98a3-045a0f648de5\") " pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.415853 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.415829 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckqdt\" (UniqueName: \"kubernetes.io/projected/1a75dc5e-d60a-432b-a1a9-4639f77052c6-kube-api-access-ckqdt\") pod \"multus-7f6gp\" (UID: \"1a75dc5e-d60a-432b-a1a9-4639f77052c6\") " pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.416864 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.416823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4v84\" (UniqueName: \"kubernetes.io/projected/af9ceced-b4ae-40c1-b7c0-77966f7a505d-kube-api-access-z4v84\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:02.417876 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.417856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7zxk\" (UniqueName: \"kubernetes.io/projected/f1b464e1-b467-43d3-8ff1-17975126be5a-kube-api-access-g7zxk\") pod \"multus-additional-cni-plugins-fbkbb\" (UID: \"f1b464e1-b467-43d3-8ff1-17975126be5a\") " pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.455251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.455223 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:48:02.491895 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.491854 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 14 22:48:02.508792 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508761 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysctl-d\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.508958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508801 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e79e59cc-8c51-48b5-83cb-d0636f606a00-tmp-dir\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.508958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-kubernetes\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.508958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508841 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-systemd\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.508958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508861 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-var-lib-kubelet\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.508958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-socket-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.508958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508892 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-kubernetes\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.508958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-host\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.508958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508947 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-systemd\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508960 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-var-lib-kubelet\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.508970 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-host\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-registration-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509030 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509031 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-socket-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509040 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysctl-d\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509059 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs98s\" (UniqueName: \"kubernetes.io/projected/03ed58c1-e0de-4014-aa24-2b69fe29c05c-kube-api-access-bs98s\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-modprobe-d\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509085 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-registration-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509092 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-etc-selinux\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509105 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e79e59cc-8c51-48b5-83cb-d0636f606a00-tmp-dir\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509120 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-run\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509147 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-sys\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-modprobe-d\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509170 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4tvn\" (UniqueName: \"kubernetes.io/projected/4421799d-5cac-4b15-b643-b2e6f184a1b7-kube-api-access-x4tvn\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509174 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-run\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509196 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-sys\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.509297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e79e59cc-8c51-48b5-83cb-d0636f606a00-hosts-file\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509219 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4421799d-5cac-4b15-b643-b2e6f184a1b7-host\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-sys-fs\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7br4b\" (UniqueName: \"kubernetes.io/projected/0127d674-0a6e-423a-a8d8-154b09d0c9b3-kube-api-access-7br4b\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509276 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e79e59cc-8c51-48b5-83cb-d0636f606a00-hosts-file\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4421799d-5cac-4b15-b643-b2e6f184a1b7-serviceca\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509340 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-sys-fs\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509344 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4421799d-5cac-4b15-b643-b2e6f184a1b7-host\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509348 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysctl-conf\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysconfig\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509391 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509407 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0127d674-0a6e-423a-a8d8-154b09d0c9b3-tmp\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509434 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysconfig\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-lib-modules\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509469 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-sysctl-conf\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509474 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-tuned\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0127d674-0a6e-423a-a8d8-154b09d0c9b3-lib-modules\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.510732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh7cf\" (UniqueName: \"kubernetes.io/projected/e79e59cc-8c51-48b5-83cb-d0636f606a00-kube-api-access-lh7cf\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.510732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509577 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-device-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.510732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509657 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/03ed58c1-e0de-4014-aa24-2b69fe29c05c-device-dir\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.510732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.509804 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4421799d-5cac-4b15-b643-b2e6f184a1b7-serviceca\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.512125 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.512068 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0127d674-0a6e-423a-a8d8-154b09d0c9b3-tmp\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.512125 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.512086 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0127d674-0a6e-423a-a8d8-154b09d0c9b3-etc-tuned\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.515642 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.515619 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:02.515774 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.515647 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:02.515774 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.515661 2568 projected.go:196] Error preparing data for projected volume kube-api-access-bs9mn for pod openshift-network-diagnostics/network-check-target-xdhpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:02.515774 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.515761 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn podName:4ff3563d-efe3-432a-80ee-c8ac236f5d4f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:03.015724138 +0000 UTC m=+3.082106892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bs9mn" (UniqueName: "kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn") pod "network-check-target-xdhpw" (UID: "4ff3563d-efe3-432a-80ee-c8ac236f5d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:02.517270 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.517244 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4tvn\" (UniqueName: \"kubernetes.io/projected/4421799d-5cac-4b15-b643-b2e6f184a1b7-kube-api-access-x4tvn\") pod \"node-ca-pwsbh\" (UID: \"4421799d-5cac-4b15-b643-b2e6f184a1b7\") " pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.517432 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.517406 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs98s\" (UniqueName: \"kubernetes.io/projected/03ed58c1-e0de-4014-aa24-2b69fe29c05c-kube-api-access-bs98s\") pod \"aws-ebs-csi-driver-node-ss45n\" (UID: \"03ed58c1-e0de-4014-aa24-2b69fe29c05c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.517816 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.517797 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7br4b\" (UniqueName: \"kubernetes.io/projected/0127d674-0a6e-423a-a8d8-154b09d0c9b3-kube-api-access-7br4b\") pod \"tuned-h6k5d\" (UID: \"0127d674-0a6e-423a-a8d8-154b09d0c9b3\") " pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.517884 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.517828 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh7cf\" (UniqueName: \"kubernetes.io/projected/e79e59cc-8c51-48b5-83cb-d0636f606a00-kube-api-access-lh7cf\") pod \"node-resolver-4nh86\" (UID: \"e79e59cc-8c51-48b5-83cb-d0636f606a00\") " pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.586984 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.586942 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9xd5f" Jun 14 22:48:02.594491 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.594469 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:02.605246 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.605223 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7f6gp" Jun 14 22:48:02.609986 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.609968 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" Jun 14 22:48:02.618600 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.618580 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:02.625105 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.625086 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" Jun 14 22:48:02.632660 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.632642 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4nh86" Jun 14 22:48:02.638167 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.638150 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" Jun 14 22:48:02.643731 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.643715 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pwsbh" Jun 14 22:48:02.912020 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.911935 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:02.912020 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:02.911984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:02.912195 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.912080 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:02.912195 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.912136 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret podName:ec01c46e-e265-407f-bce2-630e457dd40f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:03.912123204 +0000 UTC m=+3.978505941 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret") pod "global-pull-secret-syncer-pjvgp" (UID: "ec01c46e-e265-407f-bce2-630e457dd40f") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:02.912195 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.912080 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:02.912306 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:02.912203 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:48:03.912192076 +0000 UTC m=+3.978574822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:03.113619 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.113589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:03.113799 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:03.113776 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:03.113799 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:03.113799 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:03.113911 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:03.113812 2568 projected.go:196] Error preparing data for projected volume kube-api-access-bs9mn for pod openshift-network-diagnostics/network-check-target-xdhpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:03.113911 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:03.113871 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn podName:4ff3563d-efe3-432a-80ee-c8ac236f5d4f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:04.113852998 +0000 UTC m=+4.180235731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bs9mn" (UniqueName: "kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn") pod "network-check-target-xdhpw" (UID: "4ff3563d-efe3-432a-80ee-c8ac236f5d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:03.160860 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.160789 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4421799d_5cac_4b15_b643_b2e6f184a1b7.slice/crio-983fd62db10dc330c02d688aa7a68735585ebc8f9f2d2d1937d9fb2a36ac6d92 WatchSource:0}: Error finding container 983fd62db10dc330c02d688aa7a68735585ebc8f9f2d2d1937d9fb2a36ac6d92: Status 404 returned error can't find the container with id 983fd62db10dc330c02d688aa7a68735585ebc8f9f2d2d1937d9fb2a36ac6d92 Jun 14 22:48:03.162199 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.162130 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0127d674_0a6e_423a_a8d8_154b09d0c9b3.slice/crio-8a24334908dc652556e224fe43e3a642efcef5a13488cfb32d945b4716948531 WatchSource:0}: Error finding container 8a24334908dc652556e224fe43e3a642efcef5a13488cfb32d945b4716948531: Status 404 returned error can't find the container with id 8a24334908dc652556e224fe43e3a642efcef5a13488cfb32d945b4716948531 Jun 14 22:48:03.163245 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.163219 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ed58c1_e0de_4014_aa24_2b69fe29c05c.slice/crio-33b0e76f6e19f61cda3b482629dc9491b0f64370777975fc916814610017a7a7 WatchSource:0}: Error finding container 33b0e76f6e19f61cda3b482629dc9491b0f64370777975fc916814610017a7a7: Status 404 returned error can't find the container with id 33b0e76f6e19f61cda3b482629dc9491b0f64370777975fc916814610017a7a7 Jun 14 22:48:03.186596 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.186568 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d089068_2e48_485b_98a3_045a0f648de5.slice/crio-ce4e5e8502da9ed7d04781cc646b7489c493b00d21635fa51741ebaaa4d1bf07 WatchSource:0}: Error finding container ce4e5e8502da9ed7d04781cc646b7489c493b00d21635fa51741ebaaa4d1bf07: Status 404 returned error can't find the container with id ce4e5e8502da9ed7d04781cc646b7489c493b00d21635fa51741ebaaa4d1bf07 Jun 14 22:48:03.187312 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.187289 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb128a0fc_7187_4828_a0f7_d704cadb6f7d.slice/crio-413625f278ebb052a1f271525feccabaa1f8035bb41342bf8d2c29e3906ea2da WatchSource:0}: Error finding container 413625f278ebb052a1f271525feccabaa1f8035bb41342bf8d2c29e3906ea2da: Status 404 returned error can't find the container with id 413625f278ebb052a1f271525feccabaa1f8035bb41342bf8d2c29e3906ea2da Jun 14 22:48:03.188638 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.188615 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a75dc5e_d60a_432b_a1a9_4639f77052c6.slice/crio-a6409bac9ebf54cdf341870e1b620bb4792b0857f2094cce9c7f0243894a4e47 WatchSource:0}: Error finding container a6409bac9ebf54cdf341870e1b620bb4792b0857f2094cce9c7f0243894a4e47: Status 404 returned error can't find the container with id a6409bac9ebf54cdf341870e1b620bb4792b0857f2094cce9c7f0243894a4e47 Jun 14 22:48:03.189603 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.189570 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3293c7_c2f1_4760_bca0_bb88ac81481a.slice/crio-841e211a1fb0fcbe5e2bb31649c696c18a01344c97dbba0aa92de5e4792f026c WatchSource:0}: Error finding container 841e211a1fb0fcbe5e2bb31649c696c18a01344c97dbba0aa92de5e4792f026c: Status 404 returned error can't find the container with id 841e211a1fb0fcbe5e2bb31649c696c18a01344c97dbba0aa92de5e4792f026c Jun 14 22:48:03.190404 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.190365 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b464e1_b467_43d3_8ff1_17975126be5a.slice/crio-5873609d980d6801d11b04be9d2f900602d1390bf86b5424e133a451f5cb72de WatchSource:0}: Error finding container 5873609d980d6801d11b04be9d2f900602d1390bf86b5424e133a451f5cb72de: Status 404 returned error can't find the container with id 5873609d980d6801d11b04be9d2f900602d1390bf86b5424e133a451f5cb72de Jun 14 22:48:03.191169 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:03.191047 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79e59cc_8c51_48b5_83cb_d0636f606a00.slice/crio-8ba3979a804eedac88b1bcc48fccc81f31cecc8d180e8b58847c8276b1a12d9d WatchSource:0}: Error finding container 8ba3979a804eedac88b1bcc48fccc81f31cecc8d180e8b58847c8276b1a12d9d: Status 404 returned error can't find the container with id 8ba3979a804eedac88b1bcc48fccc81f31cecc8d180e8b58847c8276b1a12d9d Jun 14 22:48:03.326210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.326174 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 22:43:02 +0000 UTC" deadline="2027-12-01 14:49:46.844752015 +0000 UTC" Jun 14 22:48:03.326634 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.326223 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12832h1m43.518550928s" Jun 14 22:48:03.365911 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.365869 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pwsbh" event={"ID":"4421799d-5cac-4b15-b643-b2e6f184a1b7","Type":"ContainerStarted","Data":"983fd62db10dc330c02d688aa7a68735585ebc8f9f2d2d1937d9fb2a36ac6d92"} Jun 14 22:48:03.368366 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.368340 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" event={"ID":"e6cc1eeeda5c676493db83fa5936c2f7","Type":"ContainerStarted","Data":"96609b230734e356b5e5cc558ee10383f61917dca4cfd75daaf68fe321c366e5"} Jun 14 22:48:03.370420 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.370401 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4nh86" event={"ID":"e79e59cc-8c51-48b5-83cb-d0636f606a00","Type":"ContainerStarted","Data":"8ba3979a804eedac88b1bcc48fccc81f31cecc8d180e8b58847c8276b1a12d9d"} Jun 14 22:48:03.371345 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.371323 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9xd5f" event={"ID":"b128a0fc-7187-4828-a0f7-d704cadb6f7d","Type":"ContainerStarted","Data":"413625f278ebb052a1f271525feccabaa1f8035bb41342bf8d2c29e3906ea2da"} Jun 14 22:48:03.372788 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.372767 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"ce4e5e8502da9ed7d04781cc646b7489c493b00d21635fa51741ebaaa4d1bf07"} Jun 14 22:48:03.373842 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.373814 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" event={"ID":"03ed58c1-e0de-4014-aa24-2b69fe29c05c","Type":"ContainerStarted","Data":"33b0e76f6e19f61cda3b482629dc9491b0f64370777975fc916814610017a7a7"} Jun 14 22:48:03.374828 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.374799 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" event={"ID":"0127d674-0a6e-423a-a8d8-154b09d0c9b3","Type":"ContainerStarted","Data":"8a24334908dc652556e224fe43e3a642efcef5a13488cfb32d945b4716948531"} Jun 14 22:48:03.376052 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.376033 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" event={"ID":"f1b464e1-b467-43d3-8ff1-17975126be5a","Type":"ContainerStarted","Data":"5873609d980d6801d11b04be9d2f900602d1390bf86b5424e133a451f5cb72de"} Jun 14 22:48:03.377074 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.377047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vzqdb" event={"ID":"af3293c7-c2f1-4760-bca0-bb88ac81481a","Type":"ContainerStarted","Data":"841e211a1fb0fcbe5e2bb31649c696c18a01344c97dbba0aa92de5e4792f026c"} Jun 14 22:48:03.378306 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.378286 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7f6gp" event={"ID":"1a75dc5e-d60a-432b-a1a9-4639f77052c6","Type":"ContainerStarted","Data":"a6409bac9ebf54cdf341870e1b620bb4792b0857f2094cce9c7f0243894a4e47"} Jun 14 22:48:03.383706 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.382295 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-69.ec2.internal" podStartSLOduration=2.382279871 podStartE2EDuration="2.382279871s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:03.381492309 +0000 UTC m=+3.447875064" watchObservedRunningTime="2026-06-14 22:48:03.382279871 +0000 UTC m=+3.448662626" Jun 14 22:48:03.918582 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.918492 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:03.918582 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:03.918553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:03.918834 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:03.918674 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:03.918834 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:03.918754 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:48:05.918716854 +0000 UTC m=+5.985099597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:03.919157 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:03.919137 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:03.919238 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:03.919194 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret podName:ec01c46e-e265-407f-bce2-630e457dd40f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:05.919179314 +0000 UTC m=+5.985562052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret") pod "global-pull-secret-syncer-pjvgp" (UID: "ec01c46e-e265-407f-bce2-630e457dd40f") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:04.120403 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:04.120360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:04.120631 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:04.120554 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:04.120631 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:04.120576 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:04.120631 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:04.120588 2568 projected.go:196] Error preparing data for projected volume kube-api-access-bs9mn for pod openshift-network-diagnostics/network-check-target-xdhpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:04.120843 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:04.120646 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn podName:4ff3563d-efe3-432a-80ee-c8ac236f5d4f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:06.120628348 +0000 UTC m=+6.187011081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bs9mn" (UniqueName: "kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn") pod "network-check-target-xdhpw" (UID: "4ff3563d-efe3-432a-80ee-c8ac236f5d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:04.326887 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:04.326775 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-13 22:43:02 +0000 UTC" deadline="2028-02-05 06:11:40.491874475 +0000 UTC" Jun 14 22:48:04.326887 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:04.326841 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14407h23m36.165038532s" Jun 14 22:48:04.359223 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:04.358853 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:04.359223 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:04.358957 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:04.359223 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:04.358970 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:04.359223 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:04.359058 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:04.359223 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:04.359124 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:04.359223 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:04.359191 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:04.400877 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:04.400840 2568 generic.go:356] "Generic (PLEG): container finished" podID="23273554850e38b11c948ea91c43bdb5" containerID="61022e424819cfcb054afdd55b2a2bc74599c7c7fea6721b2698654b66f28837" exitCode=0 Jun 14 22:48:04.401412 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:04.401361 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" event={"ID":"23273554850e38b11c948ea91c43bdb5","Type":"ContainerDied","Data":"61022e424819cfcb054afdd55b2a2bc74599c7c7fea6721b2698654b66f28837"} Jun 14 22:48:05.433712 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:05.432890 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" event={"ID":"23273554850e38b11c948ea91c43bdb5","Type":"ContainerStarted","Data":"516afc7ec29f585c8f1830891989c050075949b8c296307c357043c3d041facf"} Jun 14 22:48:05.940042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:05.940005 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:05.940230 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:05.940065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:05.940230 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:05.940199 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:05.940356 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:05.940260 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:48:09.940241566 +0000 UTC m=+10.006624311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:05.940803 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:05.940780 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:05.940924 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:05.940861 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret podName:ec01c46e-e265-407f-bce2-630e457dd40f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:09.940845923 +0000 UTC m=+10.007228666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret") pod "global-pull-secret-syncer-pjvgp" (UID: "ec01c46e-e265-407f-bce2-630e457dd40f") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:06.141511 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:06.141477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:06.141693 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:06.141641 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:06.141693 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:06.141663 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:06.141693 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:06.141676 2568 projected.go:196] Error preparing data for projected volume kube-api-access-bs9mn for pod openshift-network-diagnostics/network-check-target-xdhpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:06.141871 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:06.141735 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn podName:4ff3563d-efe3-432a-80ee-c8ac236f5d4f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:10.141715845 +0000 UTC m=+10.208098596 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bs9mn" (UniqueName: "kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn") pod "network-check-target-xdhpw" (UID: "4ff3563d-efe3-432a-80ee-c8ac236f5d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:06.358141 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:06.358066 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:06.358300 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:06.358197 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:06.358520 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:06.358482 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:06.358520 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:06.358515 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:06.358661 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:06.358617 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:06.358733 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:06.358708 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:08.358932 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:08.358895 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:08.359399 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:08.359039 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:08.359485 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:08.359461 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:08.359586 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:08.359562 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:08.359656 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:08.359633 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:08.359709 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:08.359698 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:09.973518 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:09.973472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:09.974034 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:09.973588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:09.974034 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:09.973802 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:09.974034 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:09.973875 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret podName:ec01c46e-e265-407f-bce2-630e457dd40f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:17.973856398 +0000 UTC m=+18.040239138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret") pod "global-pull-secret-syncer-pjvgp" (UID: "ec01c46e-e265-407f-bce2-630e457dd40f") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:09.974034 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:09.973807 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:09.974034 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:09.973948 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:48:17.973928819 +0000 UTC m=+18.040311567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:10.175958 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:10.175890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:10.176120 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:10.176039 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:10.176120 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:10.176063 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:10.176120 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:10.176074 2568 projected.go:196] Error preparing data for projected volume kube-api-access-bs9mn for pod openshift-network-diagnostics/network-check-target-xdhpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:10.176279 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:10.176131 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn podName:4ff3563d-efe3-432a-80ee-c8ac236f5d4f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:18.176113879 +0000 UTC m=+18.242496616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bs9mn" (UniqueName: "kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn") pod "network-check-target-xdhpw" (UID: "4ff3563d-efe3-432a-80ee-c8ac236f5d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:10.358152 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:10.358071 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:10.358310 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:10.358205 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:10.364875 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:10.358609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:10.364875 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:10.358723 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:10.364875 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:10.358793 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:10.364875 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:10.358841 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:12.358294 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:12.358257 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:12.358762 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:12.358409 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:12.358762 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:12.358488 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:12.358762 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:12.358569 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:12.358762 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:12.358668 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:12.358999 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:12.358778 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:14.358704 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:14.358662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:14.359184 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:14.358662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:14.359184 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:14.358662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:14.359184 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:14.358866 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:14.359184 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:14.358932 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:14.359184 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:14.358819 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:16.358649 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:16.358611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:16.359143 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:16.358673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:16.359143 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:16.358820 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:16.359143 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:16.358889 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:16.359143 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:16.358909 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:16.359143 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:16.359001 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:18.031681 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:18.031640 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:18.032126 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:18.031699 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:18.032126 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.031816 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:18.032126 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.031830 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:18.032126 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.031887 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:48:34.031871858 +0000 UTC m=+34.098254590 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:18.032126 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.031901 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret podName:ec01c46e-e265-407f-bce2-630e457dd40f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:34.031895009 +0000 UTC m=+34.098277740 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret") pod "global-pull-secret-syncer-pjvgp" (UID: "ec01c46e-e265-407f-bce2-630e457dd40f") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:18.233621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:18.233581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:18.233836 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.233736 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:18.233836 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.233778 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:18.233836 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.233793 2568 projected.go:196] Error preparing data for projected volume kube-api-access-bs9mn for pod openshift-network-diagnostics/network-check-target-xdhpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:18.233965 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.233856 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn podName:4ff3563d-efe3-432a-80ee-c8ac236f5d4f nodeName:}" failed. No retries permitted until 2026-06-14 22:48:34.233840471 +0000 UTC m=+34.300223225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bs9mn" (UniqueName: "kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn") pod "network-check-target-xdhpw" (UID: "4ff3563d-efe3-432a-80ee-c8ac236f5d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:18.357725 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:18.357636 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:18.357725 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:18.357673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:18.357725 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:18.357636 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:18.357725 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.357778 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:18.357725 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.357841 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:18.357725 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:18.357930 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:20.359368 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:20.359333 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:20.359841 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:20.359429 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:20.359841 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:20.359443 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:20.359841 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:20.359473 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:20.359841 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:20.359556 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:20.359841 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:20.359681 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:22.358729 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.358455 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:22.359558 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.358468 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:22.359558 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.358513 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:22.359558 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:22.358858 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:22.359558 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:22.358960 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:22.359558 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:22.359038 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:22.470256 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.470224 2568 generic.go:356] "Generic (PLEG): container finished" podID="f1b464e1-b467-43d3-8ff1-17975126be5a" containerID="4fdeda7e47c3eb24d6291c19e43f84c150bf80893d24efc327ff6f474e86be98" exitCode=0 Jun 14 22:48:22.470385 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.470310 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" event={"ID":"f1b464e1-b467-43d3-8ff1-17975126be5a","Type":"ContainerDied","Data":"4fdeda7e47c3eb24d6291c19e43f84c150bf80893d24efc327ff6f474e86be98"} Jun 14 22:48:22.471944 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.471906 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vzqdb" event={"ID":"af3293c7-c2f1-4760-bca0-bb88ac81481a","Type":"ContainerStarted","Data":"af7eee9a6f47aad93f5e389f6e4d221ea138eb0e6034cfeee2fdded5718424d6"} Jun 14 22:48:22.473665 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.473639 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7f6gp" event={"ID":"1a75dc5e-d60a-432b-a1a9-4639f77052c6","Type":"ContainerStarted","Data":"c9e69dcc236eeef8766018cea46bc1d60838b4c09fe4b160b0852f4d9dcb0541"} Jun 14 22:48:22.475320 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.475270 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pwsbh" event={"ID":"4421799d-5cac-4b15-b643-b2e6f184a1b7","Type":"ContainerStarted","Data":"5a81fed6645949e006df080b23c3c8bd65ab38519c637f754cc302e38c252bf3"} Jun 14 22:48:22.476936 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.476912 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4nh86" event={"ID":"e79e59cc-8c51-48b5-83cb-d0636f606a00","Type":"ContainerStarted","Data":"9a584b9f0cef5a07cd6f06e2008c7234fd207be15589c9eeb7b8895f3fa3c8db"} Jun 14 22:48:22.479775 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.479737 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:48:22.480346 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.480208 2568 generic.go:356] "Generic (PLEG): container finished" podID="8d089068-2e48-485b-98a3-045a0f648de5" containerID="e5d224ffb1e7c905034628df7be35b5d86d031f26f62f1fa0422bfea45e3f583" exitCode=1 Jun 14 22:48:22.480346 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.480281 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"b198e97cb2794bb80f6c9f1ef5c7b6290474d44db747263f02cd10987b2b5784"} Jun 14 22:48:22.480346 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.480338 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"cbab7269bbe9509ff5ed2adf134794a3313fe8452aa30935e6873836100db439"} Jun 14 22:48:22.480564 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.480375 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"033cea0a32cf94d6c77ab45b1ccb99823e899738ce1d878d2705117e807ed135"} Jun 14 22:48:22.480564 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.480404 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerDied","Data":"e5d224ffb1e7c905034628df7be35b5d86d031f26f62f1fa0422bfea45e3f583"} Jun 14 22:48:22.480564 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.480434 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"17e0425e0e827f52b6832b52489b50b28629097c3713577f30f3756824b315c8"} Jun 14 22:48:22.482508 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.482484 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" event={"ID":"03ed58c1-e0de-4014-aa24-2b69fe29c05c","Type":"ContainerStarted","Data":"e66eddabd308a6a9d279a297c2bc079d4295dc540e1c850b595e7cbcf43e25f1"} Jun 14 22:48:22.484208 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.484188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" event={"ID":"0127d674-0a6e-423a-a8d8-154b09d0c9b3","Type":"ContainerStarted","Data":"9dccf1ebd730e315467381c4fc429718dceb0573ceb803031526338d7f659a0b"} Jun 14 22:48:22.491311 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.491263 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-69.ec2.internal" podStartSLOduration=21.491250581 podStartE2EDuration="21.491250581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:05.447711183 +0000 UTC m=+5.514093938" watchObservedRunningTime="2026-06-14 22:48:22.491250581 +0000 UTC m=+22.557633336" Jun 14 22:48:22.507000 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.506890 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7f6gp" podStartSLOduration=3.919674715 podStartE2EDuration="22.506870427s" totalImagesPullingTime="18.587195712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:22.504129588 +0000 UTC m=+22.570512324" watchObservedRunningTime="2026-06-14 22:48:22.506870427 +0000 UTC m=+22.573253184" Jun 14 22:48:22.518729 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.518682 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4nh86" podStartSLOduration=3.927205921 podStartE2EDuration="22.518662935s" totalImagesPullingTime="18.591457014s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:22.518428835 +0000 UTC m=+22.584811608" watchObservedRunningTime="2026-06-14 22:48:22.518662935 +0000 UTC m=+22.585045693" Jun 14 22:48:22.533188 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.533141 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pwsbh" podStartSLOduration=3.917167572 podStartE2EDuration="22.533125523s" totalImagesPullingTime="18.615957951s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:22.532731074 +0000 UTC m=+22.599113831" watchObservedRunningTime="2026-06-14 22:48:22.533125523 +0000 UTC m=+22.599508277" Jun 14 22:48:22.546669 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.546611 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vzqdb" podStartSLOduration=4.043252699 podStartE2EDuration="22.546596302s" totalImagesPullingTime="18.503343603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:22.546081948 +0000 UTC m=+22.612464705" watchObservedRunningTime="2026-06-14 22:48:22.546596302 +0000 UTC m=+22.612979060" Jun 14 22:48:22.561205 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:22.561154 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h6k5d" podStartSLOduration=4.019622687 podStartE2EDuration="22.561132855s" totalImagesPullingTime="18.541510168s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:22.560847163 +0000 UTC m=+22.627229924" watchObservedRunningTime="2026-06-14 22:48:22.561132855 +0000 UTC m=+22.627515610" Jun 14 22:48:23.072853 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.072818 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:23.073400 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.073385 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:23.333435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.333235 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 14 22:48:23.366302 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.366115 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-14T22:48:23.333428772Z","UUID":"f2bfb931-c033-43d0-9d7d-bd8bfc9c2e4a","Handler":null,"Name":"","Endpoint":""} Jun 14 22:48:23.369367 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.369341 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 14 22:48:23.369505 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.369390 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 14 22:48:23.489304 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.489279 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:48:23.489776 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.489731 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"cbc8f95b90637a5868a972628c68ec1dbf1388aaadb44ae9e1db138ee0e1ef61"} Jun 14 22:48:23.491662 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.491635 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" event={"ID":"03ed58c1-e0de-4014-aa24-2b69fe29c05c","Type":"ContainerStarted","Data":"4312e5bf28b561506ded2589911f8a88e74f91a82ca5d774a8a4cf57120cc1bc"} Jun 14 22:48:23.493313 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.493286 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9xd5f" event={"ID":"b128a0fc-7187-4828-a0f7-d704cadb6f7d","Type":"ContainerStarted","Data":"90088b16da2463187b95689fcc03b144742cdab3f172b2c7d83626bcaa8d1323"} Jun 14 22:48:23.493500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.493480 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:23.494041 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.494022 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vzqdb" Jun 14 22:48:23.507942 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:23.507900 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9xd5f" podStartSLOduration=4.974290164 podStartE2EDuration="23.507886502s" totalImagesPullingTime="18.533596338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:23.50729321 +0000 UTC m=+23.573675965" watchObservedRunningTime="2026-06-14 22:48:23.507886502 +0000 UTC m=+23.574269256" Jun 14 22:48:24.364075 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:24.363996 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:24.364237 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:24.364168 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:24.364595 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:24.364576 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:24.364715 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:24.364697 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:24.364802 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:24.364789 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:24.364903 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:24.364887 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:24.497821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:24.497729 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" event={"ID":"03ed58c1-e0de-4014-aa24-2b69fe29c05c","Type":"ContainerStarted","Data":"5b9055728a3edc9534491b6b2e98673fb73fb19514fac784b900d67108c90d38"} Jun 14 22:48:24.522445 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:24.522383 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ss45n" podStartSLOduration=3.940310193 podStartE2EDuration="24.522366054s" totalImagesPullingTime="20.582055861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:24.522057637 +0000 UTC m=+24.588440393" watchObservedRunningTime="2026-06-14 22:48:24.522366054 +0000 UTC m=+24.588748810" Jun 14 22:48:25.504286 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:25.504259 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:48:25.504848 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:25.504694 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"21acec78bd8ba6148fbf74b83836d4c0d267b0916537e42e5fb44d15f0db3343"} Jun 14 22:48:26.358260 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:26.358223 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:26.358419 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:26.358223 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:26.358419 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:26.358379 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:26.358567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:26.358225 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:26.358567 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:26.358457 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:26.358567 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:26.358528 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:27.510962 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:27.510736 2568 generic.go:356] "Generic (PLEG): container finished" podID="f1b464e1-b467-43d3-8ff1-17975126be5a" containerID="13e9c3f0dce8c24e66c085683cad66c623472b24db4ce5e5f6c3e9d1a46128bc" exitCode=0 Jun 14 22:48:27.511622 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:27.510839 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" event={"ID":"f1b464e1-b467-43d3-8ff1-17975126be5a","Type":"ContainerDied","Data":"13e9c3f0dce8c24e66c085683cad66c623472b24db4ce5e5f6c3e9d1a46128bc"} Jun 14 22:48:27.518065 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:27.518045 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:48:27.518377 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:27.518355 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"139fb73030c9ef6ea6602cba7df5f591319d4be29f569392a43f7d0d0a7464dd"} Jun 14 22:48:27.518660 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:27.518638 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:27.518811 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:27.518796 2568 scope.go:117] "RemoveContainer" containerID="e5d224ffb1e7c905034628df7be35b5d86d031f26f62f1fa0422bfea45e3f583" Jun 14 22:48:27.535932 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:27.535894 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:28.361585 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.361508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:28.361585 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.361546 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:28.361585 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.361551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:28.361805 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:28.361620 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:28.361805 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:28.361689 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:28.361879 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:28.361798 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:28.525056 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.525033 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:48:28.525512 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.525481 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" event={"ID":"8d089068-2e48-485b-98a3-045a0f648de5","Type":"ContainerStarted","Data":"e009278da669673caf9e3c3c2032d337723c75a7e393e082d17e3782b43f5718"} Jun 14 22:48:28.525857 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.525823 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:28.526019 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.526000 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:28.527864 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.527843 2568 generic.go:356] "Generic (PLEG): container finished" podID="f1b464e1-b467-43d3-8ff1-17975126be5a" containerID="46dd8eb44bfffbd204cd2216697822ccf03368755abd021a71660ffd50f52949" exitCode=0 Jun 14 22:48:28.527962 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.527882 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" event={"ID":"f1b464e1-b467-43d3-8ff1-17975126be5a","Type":"ContainerDied","Data":"46dd8eb44bfffbd204cd2216697822ccf03368755abd021a71660ffd50f52949"} Jun 14 22:48:28.546009 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.545884 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:48:28.556968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.556927 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" podStartSLOduration=9.752123188 podStartE2EDuration="28.55691194s" totalImagesPullingTime="18.804788752s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:28.556659807 +0000 UTC m=+28.623042560" watchObservedRunningTime="2026-06-14 22:48:28.55691194 +0000 UTC m=+28.623294959" Jun 14 22:48:28.739885 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.739852 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pjvgp"] Jun 14 22:48:28.740056 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.739987 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:28.740136 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:28.740094 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:28.742852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.742818 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdhpw"] Jun 14 22:48:28.742997 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.742941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:28.743074 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:28.743051 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:28.743441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.743422 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pwqsb"] Jun 14 22:48:28.743535 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:28.743523 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:28.743650 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:28.743626 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:29.532779 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:29.532722 2568 generic.go:356] "Generic (PLEG): container finished" podID="f1b464e1-b467-43d3-8ff1-17975126be5a" containerID="3e62d883b8204f6088693d13ec0e3b001942e92f04bd589c68a62e08a2fd449c" exitCode=0 Jun 14 22:48:29.532779 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:29.532763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" event={"ID":"f1b464e1-b467-43d3-8ff1-17975126be5a","Type":"ContainerDied","Data":"3e62d883b8204f6088693d13ec0e3b001942e92f04bd589c68a62e08a2fd449c"} Jun 14 22:48:30.359701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:30.359658 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:30.359887 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:30.359801 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:30.359887 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:30.359847 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:30.359887 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:30.359845 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:30.360062 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:30.359948 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:30.360106 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:30.360068 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:32.358706 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:32.358636 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:32.358706 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:32.358667 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:32.359514 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:32.358636 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:32.359514 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:32.358790 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:32.359514 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:32.358860 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:32.359514 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:32.358945 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:34.058973 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.058891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:34.058973 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.058945 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:34.059383 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.059058 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:34.059383 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.059111 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:49:06.059097005 +0000 UTC m=+66.125479737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 14 22:48:34.059383 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.059054 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:34.059383 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.059204 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret podName:ec01c46e-e265-407f-bce2-630e457dd40f nodeName:}" failed. No retries permitted until 2026-06-14 22:49:06.059184122 +0000 UTC m=+66.125566863 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret") pod "global-pull-secret-syncer-pjvgp" (UID: "ec01c46e-e265-407f-bce2-630e457dd40f") : object "kube-system"/"original-pull-secret" not registered Jun 14 22:48:34.261379 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.261345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:34.261564 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.261476 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 14 22:48:34.261564 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.261489 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 14 22:48:34.261564 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.261498 2568 projected.go:196] Error preparing data for projected volume kube-api-access-bs9mn for pod openshift-network-diagnostics/network-check-target-xdhpw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:34.261564 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.261547 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn podName:4ff3563d-efe3-432a-80ee-c8ac236f5d4f nodeName:}" failed. No retries permitted until 2026-06-14 22:49:06.261534837 +0000 UTC m=+66.327917569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bs9mn" (UniqueName: "kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn") pod "network-check-target-xdhpw" (UID: "4ff3563d-efe3-432a-80ee-c8ac236f5d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 14 22:48:34.358484 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.358234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:34.358638 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.358234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:34.358638 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.358523 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pjvgp" podUID="ec01c46e-e265-407f-bce2-630e457dd40f" Jun 14 22:48:34.358638 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.358265 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:34.358737 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.358586 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:48:34.358737 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.358684 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xdhpw" podUID="4ff3563d-efe3-432a-80ee-c8ac236f5d4f" Jun 14 22:48:34.548154 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.548122 2568 generic.go:356] "Generic (PLEG): container finished" podID="f1b464e1-b467-43d3-8ff1-17975126be5a" containerID="9b2a84f0b5520725c39061d85ab3c4eddcc5f07c29ff709b39ef42fbf0995e7d" exitCode=0 Jun 14 22:48:34.548340 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.548164 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" event={"ID":"f1b464e1-b467-43d3-8ff1-17975126be5a","Type":"ContainerDied","Data":"9b2a84f0b5520725c39061d85ab3c4eddcc5f07c29ff709b39ef42fbf0995e7d"} Jun 14 22:48:34.718801 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.718777 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-69.ec2.internal" event="NodeReady" Jun 14 22:48:34.718968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.718944 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 14 22:48:34.758494 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.758461 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-55m9x"] Jun 14 22:48:34.766231 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.766206 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zlrj5"] Jun 14 22:48:34.766373 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.766333 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.768443 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.768418 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 14 22:48:34.768540 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.768513 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 14 22:48:34.768540 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.768524 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jjmh8\"" Jun 14 22:48:34.778422 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.778394 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-55m9x"] Jun 14 22:48:34.778550 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.778444 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlrj5"] Jun 14 22:48:34.778550 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.778515 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlrj5" Jun 14 22:48:34.780976 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.780956 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 14 22:48:34.781078 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.781016 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 14 22:48:34.781323 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.781294 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dq9pf\"" Jun 14 22:48:34.781423 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.781367 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 14 22:48:34.866120 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.866042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dn89\" (UniqueName: \"kubernetes.io/projected/21919e62-63b8-4c0b-af0c-7465e15fc018-kube-api-access-4dn89\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.866120 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.866092 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hqg4\" (UniqueName: \"kubernetes.io/projected/c5cda7cf-a96a-4dd5-82ee-2339616c1b9a-kube-api-access-4hqg4\") pod \"ingress-canary-zlrj5\" (UID: \"c5cda7cf-a96a-4dd5-82ee-2339616c1b9a\") " pod="openshift-ingress-canary/ingress-canary-zlrj5" Jun 14 22:48:34.866361 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.866158 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21919e62-63b8-4c0b-af0c-7465e15fc018-tmp-dir\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.866361 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.866210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21919e62-63b8-4c0b-af0c-7465e15fc018-config-volume\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.866361 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.866231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5cda7cf-a96a-4dd5-82ee-2339616c1b9a-cert\") pod \"ingress-canary-zlrj5\" (UID: \"c5cda7cf-a96a-4dd5-82ee-2339616c1b9a\") " pod="openshift-ingress-canary/ingress-canary-zlrj5" Jun 14 22:48:34.866361 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.866270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.967391 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.967354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hqg4\" (UniqueName: \"kubernetes.io/projected/c5cda7cf-a96a-4dd5-82ee-2339616c1b9a-kube-api-access-4hqg4\") pod \"ingress-canary-zlrj5\" (UID: \"c5cda7cf-a96a-4dd5-82ee-2339616c1b9a\") " pod="openshift-ingress-canary/ingress-canary-zlrj5" Jun 14 22:48:34.967391 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.967396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21919e62-63b8-4c0b-af0c-7465e15fc018-tmp-dir\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.967689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.967419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21919e62-63b8-4c0b-af0c-7465e15fc018-config-volume\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.967689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.967435 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5cda7cf-a96a-4dd5-82ee-2339616c1b9a-cert\") pod \"ingress-canary-zlrj5\" (UID: \"c5cda7cf-a96a-4dd5-82ee-2339616c1b9a\") " pod="openshift-ingress-canary/ingress-canary-zlrj5" Jun 14 22:48:34.967689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.967452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.967689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.967497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dn89\" (UniqueName: \"kubernetes.io/projected/21919e62-63b8-4c0b-af0c-7465e15fc018-kube-api-access-4dn89\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.967689 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.967601 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:34.967689 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:34.967670 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:35.467650298 +0000 UTC m=+35.534033033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:48:34.968052 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.967780 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21919e62-63b8-4c0b-af0c-7465e15fc018-tmp-dir\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.968140 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.968119 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/21919e62-63b8-4c0b-af0c-7465e15fc018-config-volume\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.971621 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.971603 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5cda7cf-a96a-4dd5-82ee-2339616c1b9a-cert\") pod \"ingress-canary-zlrj5\" (UID: \"c5cda7cf-a96a-4dd5-82ee-2339616c1b9a\") " pod="openshift-ingress-canary/ingress-canary-zlrj5" Jun 14 22:48:34.977073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.977043 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dn89\" (UniqueName: \"kubernetes.io/projected/21919e62-63b8-4c0b-af0c-7465e15fc018-kube-api-access-4dn89\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:34.977691 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:34.977670 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hqg4\" (UniqueName: \"kubernetes.io/projected/c5cda7cf-a96a-4dd5-82ee-2339616c1b9a-kube-api-access-4hqg4\") pod \"ingress-canary-zlrj5\" (UID: \"c5cda7cf-a96a-4dd5-82ee-2339616c1b9a\") " pod="openshift-ingress-canary/ingress-canary-zlrj5" Jun 14 22:48:35.087935 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:35.087896 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zlrj5" Jun 14 22:48:35.280568 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:35.280539 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zlrj5"] Jun 14 22:48:35.284173 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:48:35.284149 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cda7cf_a96a_4dd5_82ee_2339616c1b9a.slice/crio-e472cd963bb7526c1a685b6f30693415a18221cfe78bbc0c8be99b38e3df3f91 WatchSource:0}: Error finding container e472cd963bb7526c1a685b6f30693415a18221cfe78bbc0c8be99b38e3df3f91: Status 404 returned error can't find the container with id e472cd963bb7526c1a685b6f30693415a18221cfe78bbc0c8be99b38e3df3f91 Jun 14 22:48:35.470885 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:35.470852 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:35.471082 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:35.470996 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:35.471082 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:35.471056 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:36.471040548 +0000 UTC m=+36.537423280 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:48:35.552855 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:35.552813 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlrj5" event={"ID":"c5cda7cf-a96a-4dd5-82ee-2339616c1b9a","Type":"ContainerStarted","Data":"e472cd963bb7526c1a685b6f30693415a18221cfe78bbc0c8be99b38e3df3f91"} Jun 14 22:48:35.556508 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:35.556480 2568 generic.go:356] "Generic (PLEG): container finished" podID="f1b464e1-b467-43d3-8ff1-17975126be5a" containerID="310833a202c3349aaa2397bf9727768ea256203dbf228974bc8732c9aaa1a82c" exitCode=0 Jun 14 22:48:35.556624 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:35.556522 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" event={"ID":"f1b464e1-b467-43d3-8ff1-17975126be5a","Type":"ContainerDied","Data":"310833a202c3349aaa2397bf9727768ea256203dbf228974bc8732c9aaa1a82c"} Jun 14 22:48:36.357883 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.357677 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:48:36.358423 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.357677 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:48:36.358423 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.357677 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:48:36.361852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.361829 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 22:48:36.361998 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.361892 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 22:48:36.361998 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.361904 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6g9m\"" Jun 14 22:48:36.361998 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.361905 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cnbs\"" Jun 14 22:48:36.361998 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.361959 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 22:48:36.361998 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.361930 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 22:48:36.477840 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.477808 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:36.478032 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:36.477978 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:36.478103 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:36.478056 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:38.478036666 +0000 UTC m=+38.544419400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:48:36.562588 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.562555 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" event={"ID":"f1b464e1-b467-43d3-8ff1-17975126be5a","Type":"ContainerStarted","Data":"a23bb4a7179f0fcef2578430ce52deff322a9e9d9656737e772a91bf9f65d01d"} Jun 14 22:48:36.583525 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:36.583471 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fbkbb" podStartSLOduration=8.438405364 podStartE2EDuration="36.583452758s" totalImagesPullingTime="28.145047394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:36.582036168 +0000 UTC m=+36.648418936" watchObservedRunningTime="2026-06-14 22:48:36.583452758 +0000 UTC m=+36.649835512" Jun 14 22:48:37.566784 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:37.566659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zlrj5" event={"ID":"c5cda7cf-a96a-4dd5-82ee-2339616c1b9a","Type":"ContainerStarted","Data":"a8f230e559e65116764c36e8a4901b3e4711e7a23360470d85c6c7231eb81f00"} Jun 14 22:48:37.584859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:37.584811 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zlrj5" podStartSLOduration=1.601053721 podStartE2EDuration="3.58479257s" totalImagesPullingTime="1.983738849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:48:37.584150885 +0000 UTC m=+37.650533639" watchObservedRunningTime="2026-06-14 22:48:37.58479257 +0000 UTC m=+37.651175342" Jun 14 22:48:38.493926 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:38.493887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:38.494102 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:38.493996 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:38.494102 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:38.494048 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:42.494033095 +0000 UTC m=+42.560415828 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:48:42.521265 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:42.521227 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:42.521803 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:42.521348 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:42.521803 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:42.521404 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:48:50.521390121 +0000 UTC m=+50.587772858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:48:50.574901 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:48:50.574854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:48:50.575501 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:50.574996 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:48:50.575501 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:48:50.575062 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:49:06.575045562 +0000 UTC m=+66.641428298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:49:00.545878 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:00.545851 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wb65p" Jun 14 22:49:06.077649 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.077604 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:49:06.077649 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.077653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:49:06.080461 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.080440 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 14 22:49:06.080573 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.080441 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 14 22:49:06.088585 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:49:06.088565 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:49:06.088677 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:49:06.088657 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:50:10.088634471 +0000 UTC m=+130.155017222 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : secret "metrics-daemon-secret" not found Jun 14 22:49:06.091678 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.091657 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ec01c46e-e265-407f-bce2-630e457dd40f-original-pull-secret\") pod \"global-pull-secret-syncer-pjvgp\" (UID: \"ec01c46e-e265-407f-bce2-630e457dd40f\") " pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:49:06.278596 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.278559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:49:06.281474 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.281458 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 14 22:49:06.291278 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.291256 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 14 22:49:06.302590 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.302566 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9mn\" (UniqueName: \"kubernetes.io/projected/4ff3563d-efe3-432a-80ee-c8ac236f5d4f-kube-api-access-bs9mn\") pod \"network-check-target-xdhpw\" (UID: \"4ff3563d-efe3-432a-80ee-c8ac236f5d4f\") " pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:49:06.370784 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.370691 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9cnbs\"" Jun 14 22:49:06.375398 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.375381 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pjvgp" Jun 14 22:49:06.379066 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.379040 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:49:06.511235 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.511201 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xdhpw"] Jun 14 22:49:06.515604 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:49:06.515578 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff3563d_efe3_432a_80ee_c8ac236f5d4f.slice/crio-6cbf13adce13b272c0d1d189c2718b9bb70c2825399c357542d10ee3d72bcd15 WatchSource:0}: Error finding container 6cbf13adce13b272c0d1d189c2718b9bb70c2825399c357542d10ee3d72bcd15: Status 404 returned error can't find the container with id 6cbf13adce13b272c0d1d189c2718b9bb70c2825399c357542d10ee3d72bcd15 Jun 14 22:49:06.527903 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.527876 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pjvgp"] Jun 14 22:49:06.533509 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:49:06.533485 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec01c46e_e265_407f_bce2_630e457dd40f.slice/crio-d83a26ccb68e6e408d38b87346b17a496edc14c0a36e0a0a9e72cea1d580c828 WatchSource:0}: Error finding container d83a26ccb68e6e408d38b87346b17a496edc14c0a36e0a0a9e72cea1d580c828: Status 404 returned error can't find the container with id d83a26ccb68e6e408d38b87346b17a496edc14c0a36e0a0a9e72cea1d580c828 Jun 14 22:49:06.581513 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.581467 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:49:06.581674 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:49:06.581625 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:49:06.581719 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:49:06.581708 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:49:38.581691407 +0000 UTC m=+98.648074144 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:49:06.634274 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.634195 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pjvgp" event={"ID":"ec01c46e-e265-407f-bce2-630e457dd40f","Type":"ContainerStarted","Data":"d83a26ccb68e6e408d38b87346b17a496edc14c0a36e0a0a9e72cea1d580c828"} Jun 14 22:49:06.635249 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:06.635225 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdhpw" event={"ID":"4ff3563d-efe3-432a-80ee-c8ac236f5d4f","Type":"ContainerStarted","Data":"6cbf13adce13b272c0d1d189c2718b9bb70c2825399c357542d10ee3d72bcd15"} Jun 14 22:49:11.648249 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:11.648203 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xdhpw" event={"ID":"4ff3563d-efe3-432a-80ee-c8ac236f5d4f","Type":"ContainerStarted","Data":"c150c2a51338440e27de8238f5be3d18a470f05006b07476063e1d17442c86bd"} Jun 14 22:49:11.648691 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:11.648296 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:49:11.649634 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:11.649613 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pjvgp" event={"ID":"ec01c46e-e265-407f-bce2-630e457dd40f","Type":"ContainerStarted","Data":"7618744a9bac6c979f4a6b573277e81849c4ab0a8abef730ca343e821755d0f8"} Jun 14 22:49:11.664008 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:11.663961 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xdhpw" podStartSLOduration=67.536361838 podStartE2EDuration="1m11.663948436s" totalImagesPullingTime="4.127586598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:49:11.662630325 +0000 UTC m=+71.729013079" watchObservedRunningTime="2026-06-14 22:49:11.663948436 +0000 UTC m=+71.730331190" Jun 14 22:49:11.674954 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:11.674904 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pjvgp" podStartSLOduration=67.562852447 podStartE2EDuration="1m11.674886433s" totalImagesPullingTime="4.112033986s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:49:11.674886252 +0000 UTC m=+71.741269022" watchObservedRunningTime="2026-06-14 22:49:11.674886433 +0000 UTC m=+71.741269189" Jun 14 22:49:38.602084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:38.601981 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:49:38.602501 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:49:38.602128 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:49:38.602501 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:49:38.602195 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:50:42.602180546 +0000 UTC m=+162.668563279 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:49:42.654967 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:49:42.654934 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xdhpw" Jun 14 22:50:10.107037 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:50:10.106976 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:50:10.107538 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:50:10.107135 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:50:10.107538 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:50:10.107221 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:52:12.107204156 +0000 UTC m=+252.173586888 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : secret "metrics-daemon-secret" not found Jun 14 22:50:37.780391 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:50:37.780345 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-55m9x" podUID="21919e62-63b8-4c0b-af0c-7465e15fc018" Jun 14 22:50:37.855575 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:50:37.855551 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-55m9x" Jun 14 22:50:39.380150 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:50:39.380092 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:50:42.629058 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:50:42.629011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:50:42.629562 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:50:42.629179 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 14 22:50:42.629562 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:50:42.629248 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls podName:21919e62-63b8-4c0b-af0c-7465e15fc018 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:44.629232998 +0000 UTC m=+284.695615731 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls") pod "dns-default-55m9x" (UID: "21919e62-63b8-4c0b-af0c-7465e15fc018") : secret "dns-default-metrics-tls" not found Jun 14 22:50:53.358604 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:50:53.358515 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:52:02.661213 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.661180 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-4jfph"] Jun 14 22:52:02.663002 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.662981 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.665132 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.665111 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d"] Jun 14 22:52:02.665733 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.665715 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 14 22:52:02.665960 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.665942 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 14 22:52:02.666175 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.666154 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qq6d4\"" Jun 14 22:52:02.666737 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.666718 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.667191 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.667174 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 14 22:52:02.668410 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.668392 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 14 22:52:02.670152 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.669587 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 14 22:52:02.670152 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.669660 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 14 22:52:02.670152 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.669661 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5m5gq\"" Jun 14 22:52:02.670152 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.669875 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:52:02.670152 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.669881 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 14 22:52:02.671478 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.671458 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 14 22:52:02.686358 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.686336 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d"] Jun 14 22:52:02.686990 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.686972 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-4jfph"] Jun 14 22:52:02.758893 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.758865 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt"] Jun 14 22:52:02.760804 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.760790 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc"] Jun 14 22:52:02.760917 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.760901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt" Jun 14 22:52:02.762421 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.762401 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-l6qgq"] Jun 14 22:52:02.762554 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.762535 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.763517 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.763499 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-94t7z\"" Jun 14 22:52:02.763931 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.763917 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.764858 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.764841 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 14 22:52:02.765099 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.765086 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 14 22:52:02.765339 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.765323 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8t97s\"" Jun 14 22:52:02.767098 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.766976 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 14 22:52:02.767098 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.766982 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 14 22:52:02.767098 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.767064 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 14 22:52:02.767252 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.767135 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 14 22:52:02.767252 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.767215 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bnthp\"" Jun 14 22:52:02.767501 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.767480 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:52:02.767607 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.767504 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 14 22:52:02.771893 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.771874 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt"] Jun 14 22:52:02.776792 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.776449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/687dc1b0-719b-449b-8391-76a06e9a6e3c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.776792 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.776635 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.776939 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.776661 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-serving-cert\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.776989 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.776867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/687dc1b0-719b-449b-8391-76a06e9a6e3c-config\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.777059 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.777033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-tmp\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.777254 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.777095 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc"] Jun 14 22:52:02.777454 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.777433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc5ch\" (UniqueName: \"kubernetes.io/projected/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-kube-api-access-dc5ch\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.777602 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.777586 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.777712 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.777699 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml9mm\" (UniqueName: \"kubernetes.io/projected/687dc1b0-719b-449b-8391-76a06e9a6e3c-kube-api-access-ml9mm\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.777829 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.777814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-snapshots\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.778818 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.778795 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-l6qgq"] Jun 14 22:52:02.780575 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.780463 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 14 22:52:02.857875 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.857840 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-st7dt"] Jun 14 22:52:02.859875 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.859859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:02.862204 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.862181 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 14 22:52:02.862464 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.862446 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 14 22:52:02.862574 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.862510 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qtzkc\"" Jun 14 22:52:02.868912 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.868890 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-st7dt"] Jun 14 22:52:02.878952 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.878932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-tmp\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.879062 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.878962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.879062 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.878985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.879062 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc5ch\" (UniqueName: \"kubernetes.io/projected/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-kube-api-access-dc5ch\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.879062 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879036 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89981dda-2420-42ba-9c6b-a2ca61f5b386-config\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.879279 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879075 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2hs5\" (UniqueName: \"kubernetes.io/projected/89981dda-2420-42ba-9c6b-a2ca61f5b386-kube-api-access-h2hs5\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.879279 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879182 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.879279 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879209 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89981dda-2420-42ba-9c6b-a2ca61f5b386-trusted-ca\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.879279 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75hz7\" (UniqueName: \"kubernetes.io/projected/4732ce32-fd2a-41a8-8426-ff46d08f0fec-kube-api-access-75hz7\") pod \"network-check-source-6947749cfc-rqrqt\" (UID: \"4732ce32-fd2a-41a8-8426-ff46d08f0fec\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt" Jun 14 22:52:02.879469 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml9mm\" (UniqueName: \"kubernetes.io/projected/687dc1b0-719b-449b-8391-76a06e9a6e3c-kube-api-access-ml9mm\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.879469 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879355 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-tmp\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.879469 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-snapshots\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.879469 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89981dda-2420-42ba-9c6b-a2ca61f5b386-serving-cert\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.879662 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879483 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/687dc1b0-719b-449b-8391-76a06e9a6e3c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.879662 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879546 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.879662 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-serving-cert\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.879662 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/687dc1b0-719b-449b-8391-76a06e9a6e3c-config\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.879884 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jrxr\" (UniqueName: \"kubernetes.io/projected/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-kube-api-access-7jrxr\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.879884 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879711 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.879884 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.879845 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-snapshots\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.880218 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.880198 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/687dc1b0-719b-449b-8391-76a06e9a6e3c-config\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.880475 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.880457 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.881815 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.881798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/687dc1b0-719b-449b-8391-76a06e9a6e3c-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.881898 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.881818 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-serving-cert\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.889848 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.889828 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc5ch\" (UniqueName: \"kubernetes.io/projected/21d8e7ab-6d4f-4410-8b6c-573ae00c5899-kube-api-access-dc5ch\") pod \"insights-operator-5bbd86d6bd-4jfph\" (UID: \"21d8e7ab-6d4f-4410-8b6c-573ae00c5899\") " pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.890138 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.890122 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml9mm\" (UniqueName: \"kubernetes.io/projected/687dc1b0-719b-449b-8391-76a06e9a6e3c-kube-api-access-ml9mm\") pod \"service-ca-operator-7ccbfd59dc-x2h5d\" (UID: \"687dc1b0-719b-449b-8391-76a06e9a6e3c\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.973553 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.973523 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" Jun 14 22:52:02.978281 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.978266 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" Jun 14 22:52:02.980063 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980039 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf45feee-c6a8-4fc1-bf88-032bae2ced72-nginx-conf\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:02.980120 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89981dda-2420-42ba-9c6b-a2ca61f5b386-serving-cert\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.980173 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980135 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jrxr\" (UniqueName: \"kubernetes.io/projected/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-kube-api-access-7jrxr\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.980261 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980248 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.980331 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:02.980386 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980346 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.980438 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89981dda-2420-42ba-9c6b-a2ca61f5b386-config\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.980438 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980424 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2hs5\" (UniqueName: \"kubernetes.io/projected/89981dda-2420-42ba-9c6b-a2ca61f5b386-kube-api-access-h2hs5\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.980539 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89981dda-2420-42ba-9c6b-a2ca61f5b386-trusted-ca\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.980539 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.980463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75hz7\" (UniqueName: \"kubernetes.io/projected/4732ce32-fd2a-41a8-8426-ff46d08f0fec-kube-api-access-75hz7\") pod \"network-check-source-6947749cfc-rqrqt\" (UID: \"4732ce32-fd2a-41a8-8426-ff46d08f0fec\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt" Jun 14 22:52:02.980886 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:02.980864 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:02.980980 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:02.980941 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls podName:d35f990e-9e37-4e40-9395-aeaa25f1ce8b nodeName:}" failed. No retries permitted until 2026-06-14 22:52:03.480922915 +0000 UTC m=+243.547305649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dcmcc" (UID: "d35f990e-9e37-4e40-9395-aeaa25f1ce8b") : secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:02.981169 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.981145 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/89981dda-2420-42ba-9c6b-a2ca61f5b386-config\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.981268 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.981178 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.981806 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.981781 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/89981dda-2420-42ba-9c6b-a2ca61f5b386-trusted-ca\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.982614 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.982588 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/89981dda-2420-42ba-9c6b-a2ca61f5b386-serving-cert\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:02.988450 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.988427 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jrxr\" (UniqueName: \"kubernetes.io/projected/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-kube-api-access-7jrxr\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:02.989934 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.989908 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75hz7\" (UniqueName: \"kubernetes.io/projected/4732ce32-fd2a-41a8-8426-ff46d08f0fec-kube-api-access-75hz7\") pod \"network-check-source-6947749cfc-rqrqt\" (UID: \"4732ce32-fd2a-41a8-8426-ff46d08f0fec\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt" Jun 14 22:52:02.990799 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:02.990780 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2hs5\" (UniqueName: \"kubernetes.io/projected/89981dda-2420-42ba-9c6b-a2ca61f5b386-kube-api-access-h2hs5\") pod \"console-operator-5dbbb5d744-l6qgq\" (UID: \"89981dda-2420-42ba-9c6b-a2ca61f5b386\") " pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:03.070328 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.070296 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt" Jun 14 22:52:03.081326 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.081290 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf45feee-c6a8-4fc1-bf88-032bae2ced72-nginx-conf\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:03.081433 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.081382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:03.081547 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:03.081524 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 22:52:03.081610 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:03.081599 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert podName:cf45feee-c6a8-4fc1-bf88-032bae2ced72 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:03.581577881 +0000 UTC m=+243.647960617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-st7dt" (UID: "cf45feee-c6a8-4fc1-bf88-032bae2ced72") : secret "networking-console-plugin-cert" not found Jun 14 22:52:03.082178 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.082151 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cf45feee-c6a8-4fc1-bf88-032bae2ced72-nginx-conf\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:03.085830 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.085800 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:03.104445 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.104416 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-4jfph"] Jun 14 22:52:03.108096 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:03.108065 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d8e7ab_6d4f_4410_8b6c_573ae00c5899.slice/crio-8affa16cab09aa2f44a08353ebcaaff2b459de7c9a66c42f8b450abff19bbefa WatchSource:0}: Error finding container 8affa16cab09aa2f44a08353ebcaaff2b459de7c9a66c42f8b450abff19bbefa: Status 404 returned error can't find the container with id 8affa16cab09aa2f44a08353ebcaaff2b459de7c9a66c42f8b450abff19bbefa Jun 14 22:52:03.119622 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.119571 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d"] Jun 14 22:52:03.121905 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:03.121871 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687dc1b0_719b_449b_8391_76a06e9a6e3c.slice/crio-9d157bdd4a127caf02e382388d659d341821a94dba2043a5227fd0512b510d79 WatchSource:0}: Error finding container 9d157bdd4a127caf02e382388d659d341821a94dba2043a5227fd0512b510d79: Status 404 returned error can't find the container with id 9d157bdd4a127caf02e382388d659d341821a94dba2043a5227fd0512b510d79 Jun 14 22:52:03.209361 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.209334 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt"] Jun 14 22:52:03.212267 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:03.212236 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4732ce32_fd2a_41a8_8426_ff46d08f0fec.slice/crio-82360a2ba7ac0a3f3f45a3843b2e5d9a3c0131b4fd272c4ba9453f4b5e3a7ac2 WatchSource:0}: Error finding container 82360a2ba7ac0a3f3f45a3843b2e5d9a3c0131b4fd272c4ba9453f4b5e3a7ac2: Status 404 returned error can't find the container with id 82360a2ba7ac0a3f3f45a3843b2e5d9a3c0131b4fd272c4ba9453f4b5e3a7ac2 Jun 14 22:52:03.224210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.224154 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-l6qgq"] Jun 14 22:52:03.227401 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:03.227374 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89981dda_2420_42ba_9c6b_a2ca61f5b386.slice/crio-9c28ee2fa841fc061f71d589dd241fe2b4d7c84a1841109eb58e11dc520cac21 WatchSource:0}: Error finding container 9c28ee2fa841fc061f71d589dd241fe2b4d7c84a1841109eb58e11dc520cac21: Status 404 returned error can't find the container with id 9c28ee2fa841fc061f71d589dd241fe2b4d7c84a1841109eb58e11dc520cac21 Jun 14 22:52:03.485371 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.485281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:03.485513 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:03.485427 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:03.485513 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:03.485489 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls podName:d35f990e-9e37-4e40-9395-aeaa25f1ce8b nodeName:}" failed. No retries permitted until 2026-06-14 22:52:04.485474623 +0000 UTC m=+244.551857359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dcmcc" (UID: "d35f990e-9e37-4e40-9395-aeaa25f1ce8b") : secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:03.586349 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:03.586317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:03.586529 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:03.586480 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 22:52:03.586605 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:03.586547 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert podName:cf45feee-c6a8-4fc1-bf88-032bae2ced72 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:04.586525364 +0000 UTC m=+244.652908112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-st7dt" (UID: "cf45feee-c6a8-4fc1-bf88-032bae2ced72") : secret "networking-console-plugin-cert" not found Jun 14 22:52:04.054114 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:04.054042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" event={"ID":"89981dda-2420-42ba-9c6b-a2ca61f5b386","Type":"ContainerStarted","Data":"9c28ee2fa841fc061f71d589dd241fe2b4d7c84a1841109eb58e11dc520cac21"} Jun 14 22:52:04.055489 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:04.055459 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" event={"ID":"687dc1b0-719b-449b-8391-76a06e9a6e3c","Type":"ContainerStarted","Data":"9d157bdd4a127caf02e382388d659d341821a94dba2043a5227fd0512b510d79"} Jun 14 22:52:04.056952 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:04.056925 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" event={"ID":"21d8e7ab-6d4f-4410-8b6c-573ae00c5899","Type":"ContainerStarted","Data":"8affa16cab09aa2f44a08353ebcaaff2b459de7c9a66c42f8b450abff19bbefa"} Jun 14 22:52:04.060105 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:04.059415 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt" event={"ID":"4732ce32-fd2a-41a8-8426-ff46d08f0fec","Type":"ContainerStarted","Data":"9e5a98fd9661dc4a0e01b2fe85c6e79338d1b0291f4acf7b2742898f5bcf63e1"} Jun 14 22:52:04.060105 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:04.059455 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt" event={"ID":"4732ce32-fd2a-41a8-8426-ff46d08f0fec","Type":"ContainerStarted","Data":"82360a2ba7ac0a3f3f45a3843b2e5d9a3c0131b4fd272c4ba9453f4b5e3a7ac2"} Jun 14 22:52:04.077987 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:04.077854 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-rqrqt" podStartSLOduration=2.077834498 podStartE2EDuration="2.077834498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:04.076515055 +0000 UTC m=+244.142897810" watchObservedRunningTime="2026-06-14 22:52:04.077834498 +0000 UTC m=+244.144217236" Jun 14 22:52:04.495373 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:04.495335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:04.495573 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:04.495522 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:04.495633 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:04.495587 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls podName:d35f990e-9e37-4e40-9395-aeaa25f1ce8b nodeName:}" failed. No retries permitted until 2026-06-14 22:52:06.495568493 +0000 UTC m=+246.561951239 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dcmcc" (UID: "d35f990e-9e37-4e40-9395-aeaa25f1ce8b") : secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:04.596012 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:04.595972 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:04.596164 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:04.596143 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 22:52:04.596220 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:04.596209 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert podName:cf45feee-c6a8-4fc1-bf88-032bae2ced72 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:06.596194802 +0000 UTC m=+246.662577534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-st7dt" (UID: "cf45feee-c6a8-4fc1-bf88-032bae2ced72") : secret "networking-console-plugin-cert" not found Jun 14 22:52:06.229026 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.228998 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc"] Jun 14 22:52:06.234949 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.234920 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" Jun 14 22:52:06.237443 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.237420 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 14 22:52:06.238340 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.238324 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-59m7j\"" Jun 14 22:52:06.238340 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.238335 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 14 22:52:06.241587 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.241564 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc"] Jun 14 22:52:06.312886 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.312845 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pwdq\" (UniqueName: \"kubernetes.io/projected/e42154f1-89ba-4d9f-8b95-5c7b09038e20-kube-api-access-7pwdq\") pod \"migrator-d4bcd4867-6vhxc\" (UID: \"e42154f1-89ba-4d9f-8b95-5c7b09038e20\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" Jun 14 22:52:06.413784 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.413660 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pwdq\" (UniqueName: \"kubernetes.io/projected/e42154f1-89ba-4d9f-8b95-5c7b09038e20-kube-api-access-7pwdq\") pod \"migrator-d4bcd4867-6vhxc\" (UID: \"e42154f1-89ba-4d9f-8b95-5c7b09038e20\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" Jun 14 22:52:06.421518 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.421489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pwdq\" (UniqueName: \"kubernetes.io/projected/e42154f1-89ba-4d9f-8b95-5c7b09038e20-kube-api-access-7pwdq\") pod \"migrator-d4bcd4867-6vhxc\" (UID: \"e42154f1-89ba-4d9f-8b95-5c7b09038e20\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" Jun 14 22:52:06.515086 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.515048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:06.515247 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:06.515221 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:06.515310 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:06.515302 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls podName:d35f990e-9e37-4e40-9395-aeaa25f1ce8b nodeName:}" failed. No retries permitted until 2026-06-14 22:52:10.5152821 +0000 UTC m=+250.581664837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dcmcc" (UID: "d35f990e-9e37-4e40-9395-aeaa25f1ce8b") : secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:06.580838 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.580798 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" Jun 14 22:52:06.616206 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.616168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:06.616365 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:06.616337 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 22:52:06.616442 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:06.616429 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert podName:cf45feee-c6a8-4fc1-bf88-032bae2ced72 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:10.616410358 +0000 UTC m=+250.682793094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-st7dt" (UID: "cf45feee-c6a8-4fc1-bf88-032bae2ced72") : secret "networking-console-plugin-cert" not found Jun 14 22:52:06.714524 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:06.714489 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc"] Jun 14 22:52:06.718465 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:06.718443 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode42154f1_89ba_4d9f_8b95_5c7b09038e20.slice/crio-e1b2228934c424f7488cec3c621df90940dda64cd903adbcc57ea66b4a14ae58 WatchSource:0}: Error finding container e1b2228934c424f7488cec3c621df90940dda64cd903adbcc57ea66b4a14ae58: Status 404 returned error can't find the container with id e1b2228934c424f7488cec3c621df90940dda64cd903adbcc57ea66b4a14ae58 Jun 14 22:52:07.071170 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.071131 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" event={"ID":"e42154f1-89ba-4d9f-8b95-5c7b09038e20","Type":"ContainerStarted","Data":"e1b2228934c424f7488cec3c621df90940dda64cd903adbcc57ea66b4a14ae58"} Jun 14 22:52:07.072670 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.072646 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/0.log" Jun 14 22:52:07.072824 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.072686 2568 generic.go:356] "Generic (PLEG): container finished" podID="89981dda-2420-42ba-9c6b-a2ca61f5b386" containerID="88e7d0366e9975cb7552691edd3467222a39711449c6cd4a14dfa66ef1c8bda7" exitCode=255 Jun 14 22:52:07.072824 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.072775 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" event={"ID":"89981dda-2420-42ba-9c6b-a2ca61f5b386","Type":"ContainerDied","Data":"88e7d0366e9975cb7552691edd3467222a39711449c6cd4a14dfa66ef1c8bda7"} Jun 14 22:52:07.072995 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.072980 2568 scope.go:117] "RemoveContainer" containerID="88e7d0366e9975cb7552691edd3467222a39711449c6cd4a14dfa66ef1c8bda7" Jun 14 22:52:07.074420 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.074399 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" event={"ID":"687dc1b0-719b-449b-8391-76a06e9a6e3c","Type":"ContainerStarted","Data":"672cba3f35632bc396a8a9ee5755d3076ec2c75c86c0033b845bf22079c30d36"} Jun 14 22:52:07.075960 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.075937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" event={"ID":"21d8e7ab-6d4f-4410-8b6c-573ae00c5899","Type":"ContainerStarted","Data":"7be014dc625f14eb08815ec6722293eef4849539ff8daee80859ecbadf62356f"} Jun 14 22:52:07.101662 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.101619 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" podStartSLOduration=2.124876752 podStartE2EDuration="5.101604283s" totalImagesPullingTime="2.976727531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:07.101189939 +0000 UTC m=+247.167572705" watchObservedRunningTime="2026-06-14 22:52:07.101604283 +0000 UTC m=+247.167987037" Jun 14 22:52:07.116122 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.116059 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" podStartSLOduration=2.156447657 podStartE2EDuration="5.116038973s" totalImagesPullingTime="2.959591316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:07.115804079 +0000 UTC m=+247.182186834" watchObservedRunningTime="2026-06-14 22:52:07.116038973 +0000 UTC m=+247.182421728" Jun 14 22:52:07.958188 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.958152 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kchb7"] Jun 14 22:52:07.961194 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.961168 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:07.963831 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.963804 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 14 22:52:07.964058 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.964044 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2789x\"" Jun 14 22:52:07.964731 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.964713 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 14 22:52:07.973945 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:07.973916 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kchb7"] Jun 14 22:52:08.029660 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.029566 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54da4925-3403-4d5d-a1e7-9b844ed49cdb-crio-socket\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.029660 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.029624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.029906 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.029781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54da4925-3403-4d5d-a1e7-9b844ed49cdb-data-volume\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.029906 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.029864 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tp44\" (UniqueName: \"kubernetes.io/projected/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-api-access-2tp44\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.029993 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.029960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.080864 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.080826 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" event={"ID":"e42154f1-89ba-4d9f-8b95-5c7b09038e20","Type":"ContainerStarted","Data":"625d9fc06261ef8d0aa6ff4e53e1bbe7d51c67a865c29eede8634e66069317cd"} Jun 14 22:52:08.081069 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.080892 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" event={"ID":"e42154f1-89ba-4d9f-8b95-5c7b09038e20","Type":"ContainerStarted","Data":"d9cfe4fb61f659200f5e9039e6cca2a1ca39489b96e9d32cd988e4c779ab8447"} Jun 14 22:52:08.082192 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.082172 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/1.log" Jun 14 22:52:08.082540 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.082523 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/0.log" Jun 14 22:52:08.082627 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.082560 2568 generic.go:356] "Generic (PLEG): container finished" podID="89981dda-2420-42ba-9c6b-a2ca61f5b386" containerID="3eefc054fc8c68f84c44de984100491c14d41fe15217d0891293498f7e49846a" exitCode=255 Jun 14 22:52:08.082694 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.082622 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" event={"ID":"89981dda-2420-42ba-9c6b-a2ca61f5b386","Type":"ContainerDied","Data":"3eefc054fc8c68f84c44de984100491c14d41fe15217d0891293498f7e49846a"} Jun 14 22:52:08.082694 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.082670 2568 scope.go:117] "RemoveContainer" containerID="88e7d0366e9975cb7552691edd3467222a39711449c6cd4a14dfa66ef1c8bda7" Jun 14 22:52:08.083008 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.082974 2568 scope.go:117] "RemoveContainer" containerID="3eefc054fc8c68f84c44de984100491c14d41fe15217d0891293498f7e49846a" Jun 14 22:52:08.083168 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.083150 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-l6qgq_openshift-console-operator(89981dda-2420-42ba-9c6b-a2ca61f5b386)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" podUID="89981dda-2420-42ba-9c6b-a2ca61f5b386" Jun 14 22:52:08.095772 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.095712 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-6vhxc" podStartSLOduration=1.040383094 podStartE2EDuration="2.095698329s" totalImagesPullingTime="1.055315235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:08.094728234 +0000 UTC m=+248.161110989" watchObservedRunningTime="2026-06-14 22:52:08.095698329 +0000 UTC m=+248.162081083" Jun 14 22:52:08.130394 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.130345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54da4925-3403-4d5d-a1e7-9b844ed49cdb-data-volume\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.130578 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.130428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tp44\" (UniqueName: \"kubernetes.io/projected/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-api-access-2tp44\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.130578 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.130470 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.130578 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.130493 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54da4925-3403-4d5d-a1e7-9b844ed49cdb-crio-socket\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.130578 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.130511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.130807 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.130611 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:08.130807 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.130629 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.130807 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.130625 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/54da4925-3403-4d5d-a1e7-9b844ed49cdb-crio-socket\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.130807 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.130676 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:08.630657321 +0000 UTC m=+248.697040060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : configmap "kube-rbac-proxy" not found Jun 14 22:52:08.130807 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.130694 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:08.630686001 +0000 UTC m=+248.697068734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.130807 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.130695 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/54da4925-3403-4d5d-a1e7-9b844ed49cdb-data-volume\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.138344 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.138322 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tp44\" (UniqueName: \"kubernetes.io/projected/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-api-access-2tp44\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.636376 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.636333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.636376 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:08.636378 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:08.636651 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.636507 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.636651 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.636578 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:08.636651 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.636610 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:09.636588236 +0000 UTC m=+249.702970971 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:08.636651 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:08.636638 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:09.636624952 +0000 UTC m=+249.703007684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : configmap "kube-rbac-proxy" not found Jun 14 22:52:09.087368 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.087339 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/1.log" Jun 14 22:52:09.087825 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.087671 2568 scope.go:117] "RemoveContainer" containerID="3eefc054fc8c68f84c44de984100491c14d41fe15217d0891293498f7e49846a" Jun 14 22:52:09.087897 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:09.087844 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-l6qgq_openshift-console-operator(89981dda-2420-42ba-9c6b-a2ca61f5b386)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" podUID="89981dda-2420-42ba-9c6b-a2ca61f5b386" Jun 14 22:52:09.645691 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.645653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:09.645691 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.645693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:09.645917 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:09.645790 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:09.645917 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:09.645828 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:09.645917 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:09.645849 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:11.645833015 +0000 UTC m=+251.712215758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : configmap "kube-rbac-proxy" not found Jun 14 22:52:09.645917 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:09.645897 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:11.645883588 +0000 UTC m=+251.712266320 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:09.659505 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.659479 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6w5h9"] Jun 14 22:52:09.663638 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.663621 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.665872 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.665849 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 14 22:52:09.665969 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.665890 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 14 22:52:09.666675 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.666659 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-245tt\"" Jun 14 22:52:09.666786 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.666698 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 14 22:52:09.666786 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.666717 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 14 22:52:09.669785 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.669765 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6w5h9"] Jun 14 22:52:09.746859 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.746817 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mqd2\" (UniqueName: \"kubernetes.io/projected/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-kube-api-access-4mqd2\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.747031 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.746867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-signing-key\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.747031 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.746887 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-signing-cabundle\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.847462 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.847418 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-signing-key\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.847462 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.847465 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-signing-cabundle\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.847729 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.847707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mqd2\" (UniqueName: \"kubernetes.io/projected/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-kube-api-access-4mqd2\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.848163 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.848143 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-signing-cabundle\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.849916 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.849895 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-signing-key\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.856139 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.856114 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mqd2\" (UniqueName: \"kubernetes.io/projected/99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff-kube-api-access-4mqd2\") pod \"service-ca-7b994bc59-6w5h9\" (UID: \"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff\") " pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:09.973476 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:09.973438 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" Jun 14 22:52:10.095530 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:10.095499 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-6w5h9"] Jun 14 22:52:10.099013 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:10.098987 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99bd0ec2_a7fb_4b5a_b92a_cfaee76660ff.slice/crio-823f3fadb5b99fae6c46277ed239c1b93a05d788bcbdd1ddda6eb88bb6fd5c2a WatchSource:0}: Error finding container 823f3fadb5b99fae6c46277ed239c1b93a05d788bcbdd1ddda6eb88bb6fd5c2a: Status 404 returned error can't find the container with id 823f3fadb5b99fae6c46277ed239c1b93a05d788bcbdd1ddda6eb88bb6fd5c2a Jun 14 22:52:10.544999 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:10.544975 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4nh86_e79e59cc-8c51-48b5-83cb-d0636f606a00/dns-node-resolver/0.log" Jun 14 22:52:10.553380 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:10.553353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:10.553528 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:10.553472 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:10.553528 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:10.553524 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls podName:d35f990e-9e37-4e40-9395-aeaa25f1ce8b nodeName:}" failed. No retries permitted until 2026-06-14 22:52:18.553510207 +0000 UTC m=+258.619892942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-dcmcc" (UID: "d35f990e-9e37-4e40-9395-aeaa25f1ce8b") : secret "cluster-monitoring-operator-tls" not found Jun 14 22:52:10.653804 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:10.653768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:10.653980 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:10.653934 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 14 22:52:10.654062 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:10.654016 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert podName:cf45feee-c6a8-4fc1-bf88-032bae2ced72 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:18.653994394 +0000 UTC m=+258.720377149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-st7dt" (UID: "cf45feee-c6a8-4fc1-bf88-032bae2ced72") : secret "networking-console-plugin-cert" not found Jun 14 22:52:11.097547 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:11.097491 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" event={"ID":"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff","Type":"ContainerStarted","Data":"c22e67f61baab5d0db43f9cd24840a1775a1161c8590a26c753b15b4971c2cab"} Jun 14 22:52:11.097959 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:11.097599 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" event={"ID":"99bd0ec2-a7fb-4b5a-b92a-cfaee76660ff","Type":"ContainerStarted","Data":"823f3fadb5b99fae6c46277ed239c1b93a05d788bcbdd1ddda6eb88bb6fd5c2a"} Jun 14 22:52:11.117553 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:11.117485 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-6w5h9" podStartSLOduration=2.117463292 podStartE2EDuration="2.117463292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:11.114097341 +0000 UTC m=+251.180480096" watchObservedRunningTime="2026-06-14 22:52:11.117463292 +0000 UTC m=+251.183846047" Jun 14 22:52:11.661361 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:11.661326 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:11.661567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:11.661374 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:11.661567 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:11.661508 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:11.661678 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:11.661606 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:15.661585112 +0000 UTC m=+255.727967851 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:11.661678 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:11.661510 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:11.661678 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:11.661643 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:15.661633642 +0000 UTC m=+255.728016378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : configmap "kube-rbac-proxy" not found Jun 14 22:52:11.745157 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:11.745122 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pwsbh_4421799d-5cac-4b15-b643-b2e6f184a1b7/node-ca/0.log" Jun 14 22:52:12.165572 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:12.165536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:52:12.165973 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:12.165689 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 14 22:52:12.165973 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:12.165782 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs podName:af9ceced-b4ae-40c1-b7c0-77966f7a505d nodeName:}" failed. No retries permitted until 2026-06-14 22:54:14.165766945 +0000 UTC m=+374.232149696 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs") pod "network-metrics-daemon-pwqsb" (UID: "af9ceced-b4ae-40c1-b7c0-77966f7a505d") : secret "metrics-daemon-secret" not found Jun 14 22:52:12.760191 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:12.760163 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlrj5_c5cda7cf-a96a-4dd5-82ee-2339616c1b9a/serve-healthcheck-canary/0.log" Jun 14 22:52:12.944158 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:12.944064 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-6vhxc_e42154f1-89ba-4d9f-8b95-5c7b09038e20/migrator/0.log" Jun 14 22:52:13.086566 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:13.086528 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:13.086735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:13.086595 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:13.087013 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:13.086996 2568 scope.go:117] "RemoveContainer" containerID="3eefc054fc8c68f84c44de984100491c14d41fe15217d0891293498f7e49846a" Jun 14 22:52:13.087189 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:13.087167 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-l6qgq_openshift-console-operator(89981dda-2420-42ba-9c6b-a2ca61f5b386)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" podUID="89981dda-2420-42ba-9c6b-a2ca61f5b386" Jun 14 22:52:13.143473 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:13.143437 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-6vhxc_e42154f1-89ba-4d9f-8b95-5c7b09038e20/graceful-termination/0.log" Jun 14 22:52:15.695196 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:15.695153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:15.695672 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:15.695259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:15.695672 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:15.695279 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 14 22:52:15.695672 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:15.695347 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 14 22:52:15.695672 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:15.695370 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:23.695353695 +0000 UTC m=+263.761736437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : configmap "kube-rbac-proxy" not found Jun 14 22:52:15.695672 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:15.695387 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls podName:54da4925-3403-4d5d-a1e7-9b844ed49cdb nodeName:}" failed. No retries permitted until 2026-06-14 22:52:23.695376666 +0000 UTC m=+263.761759402 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kchb7" (UID: "54da4925-3403-4d5d-a1e7-9b844ed49cdb") : secret "insights-runtime-extractor-tls" not found Jun 14 22:52:18.622229 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:18.622129 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:18.624525 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:18.624501 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d35f990e-9e37-4e40-9395-aeaa25f1ce8b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-dcmcc\" (UID: \"d35f990e-9e37-4e40-9395-aeaa25f1ce8b\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:18.679695 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:18.679663 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" Jun 14 22:52:18.722562 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:18.722525 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:18.724962 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:18.724935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cf45feee-c6a8-4fc1-bf88-032bae2ced72-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-st7dt\" (UID: \"cf45feee-c6a8-4fc1-bf88-032bae2ced72\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:18.768140 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:18.768112 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" Jun 14 22:52:18.806104 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:18.806076 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc"] Jun 14 22:52:18.808818 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:18.808790 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35f990e_9e37_4e40_9395_aeaa25f1ce8b.slice/crio-fd8fd22e9838e1cfa0a51f1c5683024330f66dfab8aaba1571e5e7fd2ad28ed3 WatchSource:0}: Error finding container fd8fd22e9838e1cfa0a51f1c5683024330f66dfab8aaba1571e5e7fd2ad28ed3: Status 404 returned error can't find the container with id fd8fd22e9838e1cfa0a51f1c5683024330f66dfab8aaba1571e5e7fd2ad28ed3 Jun 14 22:52:18.892738 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:18.892668 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-st7dt"] Jun 14 22:52:18.895560 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:18.895534 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf45feee_c6a8_4fc1_bf88_032bae2ced72.slice/crio-80007603161bf3acf311a5ba9471c902f6279e91b158591ca05376401e5e11df WatchSource:0}: Error finding container 80007603161bf3acf311a5ba9471c902f6279e91b158591ca05376401e5e11df: Status 404 returned error can't find the container with id 80007603161bf3acf311a5ba9471c902f6279e91b158591ca05376401e5e11df Jun 14 22:52:19.131249 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:19.131208 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" event={"ID":"cf45feee-c6a8-4fc1-bf88-032bae2ced72","Type":"ContainerStarted","Data":"80007603161bf3acf311a5ba9471c902f6279e91b158591ca05376401e5e11df"} Jun 14 22:52:19.132279 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:19.132248 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" event={"ID":"d35f990e-9e37-4e40-9395-aeaa25f1ce8b","Type":"ContainerStarted","Data":"fd8fd22e9838e1cfa0a51f1c5683024330f66dfab8aaba1571e5e7fd2ad28ed3"} Jun 14 22:52:21.141017 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:21.140977 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" event={"ID":"d35f990e-9e37-4e40-9395-aeaa25f1ce8b","Type":"ContainerStarted","Data":"6e153461beddf3bbf4c2e20d179455f3ed2b1f173b9757c4fdde26ab5fc8ce91"} Jun 14 22:52:21.142477 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:21.142449 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" event={"ID":"cf45feee-c6a8-4fc1-bf88-032bae2ced72","Type":"ContainerStarted","Data":"94c4350a80773e6239333132bb45d539e527d96c986180cd723abefb8e1b851f"} Jun 14 22:52:21.156526 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:21.156476 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-dcmcc" podStartSLOduration=17.390470753 podStartE2EDuration="19.156438099s" totalImagesPullingTime="1.765967346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:21.155983298 +0000 UTC m=+261.222366053" watchObservedRunningTime="2026-06-14 22:52:21.156438099 +0000 UTC m=+261.222820854" Jun 14 22:52:21.175384 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:21.175339 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-st7dt" podStartSLOduration=17.499759961 podStartE2EDuration="19.175326044s" totalImagesPullingTime="1.675566083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:21.174440244 +0000 UTC m=+261.240822998" watchObservedRunningTime="2026-06-14 22:52:21.175326044 +0000 UTC m=+261.241708798" Jun 14 22:52:23.768268 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:23.768230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:23.768268 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:23.768275 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:23.768740 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:23.768722 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/54da4925-3403-4d5d-a1e7-9b844ed49cdb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:23.770594 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:23.770569 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/54da4925-3403-4d5d-a1e7-9b844ed49cdb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kchb7\" (UID: \"54da4925-3403-4d5d-a1e7-9b844ed49cdb\") " pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:23.870869 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:23.870816 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kchb7" Jun 14 22:52:23.998811 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:23.998778 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kchb7"] Jun 14 22:52:24.001527 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:24.001501 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54da4925_3403_4d5d_a1e7_9b844ed49cdb.slice/crio-63c1a8c6624abe47f95cc39db08fda0c0c1f0fe7b973d8f5b473d552fd8d7680 WatchSource:0}: Error finding container 63c1a8c6624abe47f95cc39db08fda0c0c1f0fe7b973d8f5b473d552fd8d7680: Status 404 returned error can't find the container with id 63c1a8c6624abe47f95cc39db08fda0c0c1f0fe7b973d8f5b473d552fd8d7680 Jun 14 22:52:24.154941 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:24.154859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kchb7" event={"ID":"54da4925-3403-4d5d-a1e7-9b844ed49cdb","Type":"ContainerStarted","Data":"63c1a8c6624abe47f95cc39db08fda0c0c1f0fe7b973d8f5b473d552fd8d7680"} Jun 14 22:52:28.171343 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:28.171312 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kchb7" event={"ID":"54da4925-3403-4d5d-a1e7-9b844ed49cdb","Type":"ContainerStarted","Data":"800d2c0d063a001ed249391be6164c1e18ee692d060149a81cd3555f1723ad33"} Jun 14 22:52:28.171732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:28.171366 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kchb7" event={"ID":"54da4925-3403-4d5d-a1e7-9b844ed49cdb","Type":"ContainerStarted","Data":"f1e374079913e448f32ec162ab4581a2a8bed665b837cbd1e2cb59f9708c0938"} Jun 14 22:52:28.359090 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:28.359010 2568 scope.go:117] "RemoveContainer" containerID="3eefc054fc8c68f84c44de984100491c14d41fe15217d0891293498f7e49846a" Jun 14 22:52:29.176312 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:29.176286 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 22:52:29.176825 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:29.176802 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/1.log" Jun 14 22:52:29.176946 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:29.176845 2568 generic.go:356] "Generic (PLEG): container finished" podID="89981dda-2420-42ba-9c6b-a2ca61f5b386" containerID="0d1bebb80029f455ea64ecf96e6c7cb0224b7a7d9ae43e374d83236a57b76592" exitCode=255 Jun 14 22:52:29.176946 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:29.176902 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" event={"ID":"89981dda-2420-42ba-9c6b-a2ca61f5b386","Type":"ContainerDied","Data":"0d1bebb80029f455ea64ecf96e6c7cb0224b7a7d9ae43e374d83236a57b76592"} Jun 14 22:52:29.177046 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:29.176961 2568 scope.go:117] "RemoveContainer" containerID="3eefc054fc8c68f84c44de984100491c14d41fe15217d0891293498f7e49846a" Jun 14 22:52:29.177328 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:29.177297 2568 scope.go:117] "RemoveContainer" containerID="0d1bebb80029f455ea64ecf96e6c7cb0224b7a7d9ae43e374d83236a57b76592" Jun 14 22:52:29.177519 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:29.177493 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-l6qgq_openshift-console-operator(89981dda-2420-42ba-9c6b-a2ca61f5b386)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" podUID="89981dda-2420-42ba-9c6b-a2ca61f5b386" Jun 14 22:52:30.181940 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:30.181909 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 22:52:30.183873 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:30.183848 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kchb7" event={"ID":"54da4925-3403-4d5d-a1e7-9b844ed49cdb","Type":"ContainerStarted","Data":"c4023a4ab224010a138c500b29a0c28deeb86c9a2df3e1e7c211a5032ab8e4de"} Jun 14 22:52:30.202620 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:30.202572 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kchb7" podStartSLOduration=17.564928317 podStartE2EDuration="23.202557164s" totalImagesPullingTime="5.637628847s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 22:52:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:30.20165584 +0000 UTC m=+270.268038593" watchObservedRunningTime="2026-06-14 22:52:30.202557164 +0000 UTC m=+270.268939918" Jun 14 22:52:33.086562 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.086519 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:33.086966 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.086587 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:33.086966 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.086901 2568 scope.go:117] "RemoveContainer" containerID="0d1bebb80029f455ea64ecf96e6c7cb0224b7a7d9ae43e374d83236a57b76592" Jun 14 22:52:33.087073 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:33.087054 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-l6qgq_openshift-console-operator(89981dda-2420-42ba-9c6b-a2ca61f5b386)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" podUID="89981dda-2420-42ba-9c6b-a2ca61f5b386" Jun 14 22:52:33.095303 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.095276 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-x725d"] Jun 14 22:52:33.097262 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.097248 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.099248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.099224 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n68fr\"" Jun 14 22:52:33.099342 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.099245 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 14 22:52:33.099342 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.099297 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 14 22:52:33.099453 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.099341 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 14 22:52:33.106576 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.106553 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-x725d"] Jun 14 22:52:33.139096 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.139059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.139242 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.139106 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.139328 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.139271 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcl4h\" (UniqueName: \"kubernetes.io/projected/ec1d5d36-99b0-4563-be9c-ea26c279cac4-kube-api-access-bcl4h\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.139410 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.139392 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec1d5d36-99b0-4563-be9c-ea26c279cac4-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.239847 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.239814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec1d5d36-99b0-4563-be9c-ea26c279cac4-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.239979 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.239890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.239979 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.239921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.240073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.239991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcl4h\" (UniqueName: \"kubernetes.io/projected/ec1d5d36-99b0-4563-be9c-ea26c279cac4-kube-api-access-bcl4h\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.240116 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:33.240081 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 14 22:52:33.243819 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:33.240504 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-tls podName:ec1d5d36-99b0-4563-be9c-ea26c279cac4 nodeName:}" failed. No retries permitted until 2026-06-14 22:52:33.74012974 +0000 UTC m=+273.806512484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-x725d" (UID: "ec1d5d36-99b0-4563-be9c-ea26c279cac4") : secret "prometheus-operator-tls" not found Jun 14 22:52:33.243819 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.240992 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec1d5d36-99b0-4563-be9c-ea26c279cac4-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.246578 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.246547 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.248606 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.248583 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcl4h\" (UniqueName: \"kubernetes.io/projected/ec1d5d36-99b0-4563-be9c-ea26c279cac4-kube-api-access-bcl4h\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.743471 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.743422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:33.745773 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:33.745729 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ec1d5d36-99b0-4563-be9c-ea26c279cac4-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-x725d\" (UID: \"ec1d5d36-99b0-4563-be9c-ea26c279cac4\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:34.005655 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:34.005563 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" Jun 14 22:52:34.128118 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:34.128092 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-x725d"] Jun 14 22:52:34.130465 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:34.130442 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1d5d36_99b0_4563_be9c_ea26c279cac4.slice/crio-ff8651d286e796fa17ae3630917f2616c39af61b29072e4f9d20b9d8c408a0ff WatchSource:0}: Error finding container ff8651d286e796fa17ae3630917f2616c39af61b29072e4f9d20b9d8c408a0ff: Status 404 returned error can't find the container with id ff8651d286e796fa17ae3630917f2616c39af61b29072e4f9d20b9d8c408a0ff Jun 14 22:52:34.197533 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:34.197500 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" event={"ID":"ec1d5d36-99b0-4563-be9c-ea26c279cac4","Type":"ContainerStarted","Data":"ff8651d286e796fa17ae3630917f2616c39af61b29072e4f9d20b9d8c408a0ff"} Jun 14 22:52:36.207948 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:36.207914 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" event={"ID":"ec1d5d36-99b0-4563-be9c-ea26c279cac4","Type":"ContainerStarted","Data":"a5dffd816cc521f9b58ce6ccd3a00446e852497733dc65862614179ab29aede8"} Jun 14 22:52:36.208423 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:36.207969 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" event={"ID":"ec1d5d36-99b0-4563-be9c-ea26c279cac4","Type":"ContainerStarted","Data":"205a7a90b630aa436ca048eae2d5537a2d02294030c6c8922cd3329ea3f2132e"} Jun 14 22:52:36.222904 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:36.222851 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-x725d" podStartSLOduration=2.205420791 podStartE2EDuration="3.222832781s" totalImagesPullingTime="1.01741199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:36.22222654 +0000 UTC m=+276.288609297" watchObservedRunningTime="2026-06-14 22:52:36.222832781 +0000 UTC m=+276.289215536" Jun 14 22:52:38.426601 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.426562 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4crc2"] Jun 14 22:52:38.429762 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.429727 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.432423 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.432402 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 14 22:52:38.433716 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.433682 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6t9nr\"" Jun 14 22:52:38.433853 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.433769 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 14 22:52:38.433853 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.433789 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 14 22:52:38.440678 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.440561 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sl6vk"] Jun 14 22:52:38.447908 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.447881 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4crc2"] Jun 14 22:52:38.448051 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.448038 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.450878 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.450644 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 14 22:52:38.450878 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.450733 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 14 22:52:38.450878 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.450782 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 14 22:52:38.450878 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.450734 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t8p9k\"" Jun 14 22:52:38.477330 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477304 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-accelerators-collector-config\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477463 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.477463 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-tls\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477463 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-wtmp\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477641 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgzkz\" (UniqueName: \"kubernetes.io/projected/91aacdba-6522-40a4-813a-9c3a9ef5b62e-kube-api-access-pgzkz\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477641 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477518 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-sys\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477641 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-root\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477641 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91aacdba-6522-40a4-813a-9c3a9ef5b62e-metrics-client-ca\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.477852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477685 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.477852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-textfile\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.477852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.477852 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477829 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svbqf\" (UniqueName: \"kubernetes.io/projected/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-api-access-svbqf\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.478125 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.477860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.578887 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.578851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-wtmp\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.578887 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.578886 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgzkz\" (UniqueName: \"kubernetes.io/projected/91aacdba-6522-40a4-813a-9c3a9ef5b62e-kube-api-access-pgzkz\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579094 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.578915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-sys\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579094 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.578937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-root\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579094 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.578959 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91aacdba-6522-40a4-813a-9c3a9ef5b62e-metrics-client-ca\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579094 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.578999 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.579094 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579026 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-sys\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579094 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579035 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-wtmp\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579094 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.579094 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579080 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/91aacdba-6522-40a4-813a-9c3a9ef5b62e-root\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579498 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579139 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-textfile\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579498 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.579498 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579498 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579248 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svbqf\" (UniqueName: \"kubernetes.io/projected/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-api-access-svbqf\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.579498 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.579498 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579312 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-accelerators-collector-config\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579498 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579349 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.579498 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-tls\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.579905 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.579652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.580340 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.580314 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-textfile\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.580442 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:38.580404 2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 14 22:52:38.580500 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:38.580463 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls podName:2a690e2e-7238-4d2f-98e7-5f6981b6df0e nodeName:}" failed. No retries permitted until 2026-06-14 22:52:39.08044542 +0000 UTC m=+279.146828152 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-4crc2" (UID: "2a690e2e-7238-4d2f-98e7-5f6981b6df0e") : secret "kube-state-metrics-tls" not found Jun 14 22:52:38.580848 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.580822 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91aacdba-6522-40a4-813a-9c3a9ef5b62e-metrics-client-ca\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.581209 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.581182 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.581570 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.581545 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-accelerators-collector-config\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.582239 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.582219 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.582715 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.582685 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-tls\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.583050 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.583026 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91aacdba-6522-40a4-813a-9c3a9ef5b62e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.583653 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.583628 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.588240 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.588217 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgzkz\" (UniqueName: \"kubernetes.io/projected/91aacdba-6522-40a4-813a-9c3a9ef5b62e-kube-api-access-pgzkz\") pod \"node-exporter-sl6vk\" (UID: \"91aacdba-6522-40a4-813a-9c3a9ef5b62e\") " pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.588564 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.588547 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svbqf\" (UniqueName: \"kubernetes.io/projected/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-api-access-svbqf\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:38.761911 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:38.761825 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sl6vk" Jun 14 22:52:38.774735 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:38.774698 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91aacdba_6522_40a4_813a_9c3a9ef5b62e.slice/crio-e412c762a23d6d7b260771f8273057466ceaeffbd46d9480536e4d16bb99ab57 WatchSource:0}: Error finding container e412c762a23d6d7b260771f8273057466ceaeffbd46d9480536e4d16bb99ab57: Status 404 returned error can't find the container with id e412c762a23d6d7b260771f8273057466ceaeffbd46d9480536e4d16bb99ab57 Jun 14 22:52:39.083162 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.083079 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:39.083395 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:39.083264 2568 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 14 22:52:39.083395 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:39.083343 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls podName:2a690e2e-7238-4d2f-98e7-5f6981b6df0e nodeName:}" failed. No retries permitted until 2026-06-14 22:52:40.083322951 +0000 UTC m=+280.149705696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls") pod "kube-state-metrics-678bc549d7-4crc2" (UID: "2a690e2e-7238-4d2f-98e7-5f6981b6df0e") : secret "kube-state-metrics-tls" not found Jun 14 22:52:39.218917 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.218876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sl6vk" event={"ID":"91aacdba-6522-40a4-813a-9c3a9ef5b62e","Type":"ContainerStarted","Data":"e412c762a23d6d7b260771f8273057466ceaeffbd46d9480536e4d16bb99ab57"} Jun 14 22:52:39.565962 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.565925 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:52:39.586558 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.586512 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.587443 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.587411 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:52:39.589065 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.589008 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 22:52:39.589194 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.589135 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 22:52:39.589762 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.589724 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 22:52:39.589875 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.589828 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 22:52:39.589938 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.589724 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 22:52:39.590109 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.590091 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 22:52:39.590253 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.590190 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 22:52:39.590253 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.590010 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ndnh4\"" Jun 14 22:52:39.590435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.590402 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 22:52:39.590435 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.590415 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 22:52:39.688949 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.688911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.688949 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.688960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689207 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.688982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689207 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689207 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689130 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-volume\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689207 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689412 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-web-config\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689412 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689412 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-out\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689412 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r4dj\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-kube-api-access-7r4dj\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689412 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689385 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689657 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689443 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.689657 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.689469 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.790676 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.790645 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.790676 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.790681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.790932 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.790731 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.790932 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.790899 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.790932 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.790931 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.791251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.790971 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.791251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.791003 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-volume\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.791251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.791029 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.791251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.791080 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-web-config\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.791251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.791110 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.791251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.791153 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-out\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.791251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.791158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.791845 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.791820 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.792129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.792104 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.794194 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.793991 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.794194 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.794040 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r4dj\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-kube-api-access-7r4dj\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.794194 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.794077 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.794416 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.794382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-out\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.794596 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.794530 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-volume\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.794894 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.794867 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.795097 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.795068 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.795183 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.795146 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.795556 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.795530 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-web-config\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.796539 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.796517 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.796539 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.796531 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.801660 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.801640 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r4dj\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-kube-api-access-7r4dj\") pod \"alertmanager-main-0\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:39.900788 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:39.900701 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:52:40.097093 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:40.096673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:40.099384 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:40.099359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2a690e2e-7238-4d2f-98e7-5f6981b6df0e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-4crc2\" (UID: \"2a690e2e-7238-4d2f-98e7-5f6981b6df0e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:40.116345 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:40.116320 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:52:40.118435 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:40.118413 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7709ff4b_0f2a_4b2e_888f_7214fccd8339.slice/crio-d68a9922f30b121cde382a2e0a37ddd63e6c3fb486bea70bb3cb6d5e9175229f WatchSource:0}: Error finding container d68a9922f30b121cde382a2e0a37ddd63e6c3fb486bea70bb3cb6d5e9175229f: Status 404 returned error can't find the container with id d68a9922f30b121cde382a2e0a37ddd63e6c3fb486bea70bb3cb6d5e9175229f Jun 14 22:52:40.223828 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:40.223795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerStarted","Data":"d68a9922f30b121cde382a2e0a37ddd63e6c3fb486bea70bb3cb6d5e9175229f"} Jun 14 22:52:40.225357 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:40.225331 2568 generic.go:356] "Generic (PLEG): container finished" podID="91aacdba-6522-40a4-813a-9c3a9ef5b62e" containerID="287915fba6405999936b205be12de703154ec4e78a0d40bef75ef0093ca3a572" exitCode=0 Jun 14 22:52:40.225448 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:40.225371 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sl6vk" event={"ID":"91aacdba-6522-40a4-813a-9c3a9ef5b62e","Type":"ContainerDied","Data":"287915fba6405999936b205be12de703154ec4e78a0d40bef75ef0093ca3a572"} Jun 14 22:52:40.244299 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:40.244273 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" Jun 14 22:52:40.378714 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:40.378689 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-4crc2"] Jun 14 22:52:40.381445 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:40.381420 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a690e2e_7238_4d2f_98e7_5f6981b6df0e.slice/crio-11ebc938f70d2bd6ef5205f1e020a6df3735c351a41eb69db7497fefd6e7dbce WatchSource:0}: Error finding container 11ebc938f70d2bd6ef5205f1e020a6df3735c351a41eb69db7497fefd6e7dbce: Status 404 returned error can't find the container with id 11ebc938f70d2bd6ef5205f1e020a6df3735c351a41eb69db7497fefd6e7dbce Jun 14 22:52:40.857074 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:40.857033 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-55m9x" podUID="21919e62-63b8-4c0b-af0c-7465e15fc018" Jun 14 22:52:41.232014 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.231966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sl6vk" event={"ID":"91aacdba-6522-40a4-813a-9c3a9ef5b62e","Type":"ContainerStarted","Data":"8fd50bb8ed3eee7c9c032e0df247889db4502670600f88ea8ca9658e334de526"} Jun 14 22:52:41.232204 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.232078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sl6vk" event={"ID":"91aacdba-6522-40a4-813a-9c3a9ef5b62e","Type":"ContainerStarted","Data":"a01f833fa1c412a4f10a48342a0eb1d5e9e0cf1ac76ecb16f95bb5ffb4308895"} Jun 14 22:52:41.233322 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.233291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" event={"ID":"2a690e2e-7238-4d2f-98e7-5f6981b6df0e","Type":"ContainerStarted","Data":"11ebc938f70d2bd6ef5205f1e020a6df3735c351a41eb69db7497fefd6e7dbce"} Jun 14 22:52:41.233443 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.233300 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-55m9x" Jun 14 22:52:41.251352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.251295 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sl6vk" podStartSLOduration=1.9650766389999998 podStartE2EDuration="3.251275964s" totalImagesPullingTime="1.205110159s" totalInitContainerRuntime="81.089166ms" isStatefulPod=true podCreationTimestamp="2026-06-14 22:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:41.24930703 +0000 UTC m=+281.315689785" watchObservedRunningTime="2026-06-14 22:52:41.251275964 +0000 UTC m=+281.317658720" Jun 14 22:52:41.530057 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.529972 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-59bd89d576-7m542"] Jun 14 22:52:41.563837 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.563805 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59bd89d576-7m542"] Jun 14 22:52:41.563983 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.563898 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.566438 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.566403 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 14 22:52:41.566580 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.566450 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 14 22:52:41.567050 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.566816 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8ahuu0voi6e94\"" Jun 14 22:52:41.567050 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.566881 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 14 22:52:41.567050 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.566885 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pcz2d\"" Jun 14 22:52:41.567050 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.566887 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 14 22:52:41.567050 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.566891 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 14 22:52:41.610250 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.610226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.610376 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.610258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.610376 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.610280 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-metrics-client-ca\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.610465 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.610401 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.610465 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.610425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.610539 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.610465 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdlg9\" (UniqueName: \"kubernetes.io/projected/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-kube-api-access-qdlg9\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.610572 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.610538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-tls\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.610616 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.610566 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-grpc-tls\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.711706 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.711676 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.711897 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.711734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdlg9\" (UniqueName: \"kubernetes.io/projected/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-kube-api-access-qdlg9\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.711897 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.711827 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-tls\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.711897 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.711853 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-grpc-tls\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.711897 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.711886 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.712113 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.711917 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.712113 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.711946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-metrics-client-ca\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.712113 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.712014 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.713013 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.712958 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-metrics-client-ca\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.715147 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.715101 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-tls\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.715904 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.715780 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.715904 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.715856 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.717603 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.717562 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.717714 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.717626 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-grpc-tls\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.718233 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.718209 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.719628 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.719603 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdlg9\" (UniqueName: \"kubernetes.io/projected/7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4-kube-api-access-qdlg9\") pod \"thanos-querier-59bd89d576-7m542\" (UID: \"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4\") " pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:41.873204 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:41.873124 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:42.154331 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:42.154295 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-59bd89d576-7m542"] Jun 14 22:52:42.158625 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:42.158600 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd7ee4c_8a25_4f49_8d9d_fe12400aaad4.slice/crio-eef458d32c4af92c598757d377f62b7b461e5a9873cb0bfdb2c6c0ae0b1c5f00 WatchSource:0}: Error finding container eef458d32c4af92c598757d377f62b7b461e5a9873cb0bfdb2c6c0ae0b1c5f00: Status 404 returned error can't find the container with id eef458d32c4af92c598757d377f62b7b461e5a9873cb0bfdb2c6c0ae0b1c5f00 Jun 14 22:52:42.237774 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:42.237714 2568 generic.go:356] "Generic (PLEG): container finished" podID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerID="293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78" exitCode=0 Jun 14 22:52:42.237920 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:42.237802 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerDied","Data":"293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78"} Jun 14 22:52:42.238890 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:42.238872 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" event={"ID":"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4","Type":"ContainerStarted","Data":"eef458d32c4af92c598757d377f62b7b461e5a9873cb0bfdb2c6c0ae0b1c5f00"} Jun 14 22:52:43.200520 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.200456 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk"] Jun 14 22:52:43.225080 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.225037 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk"] Jun 14 22:52:43.225238 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.225181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:43.229054 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.228576 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5lds2\"" Jun 14 22:52:43.229790 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.229349 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 14 22:52:43.250058 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.250022 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" event={"ID":"2a690e2e-7238-4d2f-98e7-5f6981b6df0e","Type":"ContainerStarted","Data":"3ca1500a4f87dde1ccf593383d55dd277e6dd5f1befbd4026937624c65b1aa28"} Jun 14 22:52:43.250348 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.250317 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" event={"ID":"2a690e2e-7238-4d2f-98e7-5f6981b6df0e","Type":"ContainerStarted","Data":"11ef77f684a7cac03ecf3999e1c57a3ae5ffbb3daab5659c83f7a4347a43659b"} Jun 14 22:52:43.250430 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.250367 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" event={"ID":"2a690e2e-7238-4d2f-98e7-5f6981b6df0e","Type":"ContainerStarted","Data":"bc5ad31540c50fd30872b1ae266b3f21d519848a421b76fd7c32d34dc383e407"} Jun 14 22:52:43.266821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.266762 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-4crc2" podStartSLOduration=3.274220631 podStartE2EDuration="5.266718272s" totalImagesPullingTime="1.992497641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:43.265885151 +0000 UTC m=+283.332267916" watchObservedRunningTime="2026-06-14 22:52:43.266718272 +0000 UTC m=+283.333101028" Jun 14 22:52:43.326814 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.326773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea4e9010-ca54-4865-8950-309ad61f3352-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-hf2dk\" (UID: \"ea4e9010-ca54-4865-8950-309ad61f3352\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:43.326998 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.326847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szz6q\" (UniqueName: \"kubernetes.io/projected/ea4e9010-ca54-4865-8950-309ad61f3352-kube-api-access-szz6q\") pod \"monitoring-plugin-589576dfc7-hf2dk\" (UID: \"ea4e9010-ca54-4865-8950-309ad61f3352\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:43.427789 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.427722 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea4e9010-ca54-4865-8950-309ad61f3352-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-hf2dk\" (UID: \"ea4e9010-ca54-4865-8950-309ad61f3352\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:43.427984 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.427819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szz6q\" (UniqueName: \"kubernetes.io/projected/ea4e9010-ca54-4865-8950-309ad61f3352-kube-api-access-szz6q\") pod \"monitoring-plugin-589576dfc7-hf2dk\" (UID: \"ea4e9010-ca54-4865-8950-309ad61f3352\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:43.430495 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.430470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea4e9010-ca54-4865-8950-309ad61f3352-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-hf2dk\" (UID: \"ea4e9010-ca54-4865-8950-309ad61f3352\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:43.435534 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.435510 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szz6q\" (UniqueName: \"kubernetes.io/projected/ea4e9010-ca54-4865-8950-309ad61f3352-kube-api-access-szz6q\") pod \"monitoring-plugin-589576dfc7-hf2dk\" (UID: \"ea4e9010-ca54-4865-8950-309ad61f3352\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:43.543901 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:43.543817 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:44.640336 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:44.640082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:52:44.644301 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:44.643390 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/21919e62-63b8-4c0b-af0c-7465e15fc018-metrics-tls\") pod \"dns-default-55m9x\" (UID: \"21919e62-63b8-4c0b-af0c-7465e15fc018\") " pod="openshift-dns/dns-default-55m9x" Jun 14 22:52:44.752345 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:44.752314 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk"] Jun 14 22:52:44.756498 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:44.756471 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4e9010_ca54_4865_8950_309ad61f3352.slice/crio-29f237f7ace3a32dae4b42b40516a4137c962c6cab40817c85cc8466b4f5afff WatchSource:0}: Error finding container 29f237f7ace3a32dae4b42b40516a4137c962c6cab40817c85cc8466b4f5afff: Status 404 returned error can't find the container with id 29f237f7ace3a32dae4b42b40516a4137c962c6cab40817c85cc8466b4f5afff Jun 14 22:52:44.836326 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:44.836301 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jjmh8\"" Jun 14 22:52:44.844766 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:44.844716 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-55m9x" Jun 14 22:52:45.006828 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.006803 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-55m9x"] Jun 14 22:52:45.009113 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:45.009087 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21919e62_63b8_4c0b_af0c_7465e15fc018.slice/crio-fa0aed3e58a72d752c755e6e850aa9e293d0853051d65957d493ff74356190be WatchSource:0}: Error finding container fa0aed3e58a72d752c755e6e850aa9e293d0853051d65957d493ff74356190be: Status 404 returned error can't find the container with id fa0aed3e58a72d752c755e6e850aa9e293d0853051d65957d493ff74356190be Jun 14 22:52:45.261488 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.261452 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerStarted","Data":"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d"} Jun 14 22:52:45.261669 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.261529 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerStarted","Data":"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339"} Jun 14 22:52:45.261669 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.261569 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerStarted","Data":"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b"} Jun 14 22:52:45.261669 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.261605 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerStarted","Data":"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a"} Jun 14 22:52:45.261669 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.261639 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerStarted","Data":"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a"} Jun 14 22:52:45.262553 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.262530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-55m9x" event={"ID":"21919e62-63b8-4c0b-af0c-7465e15fc018","Type":"ContainerStarted","Data":"fa0aed3e58a72d752c755e6e850aa9e293d0853051d65957d493ff74356190be"} Jun 14 22:52:45.264404 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.264383 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" event={"ID":"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4","Type":"ContainerStarted","Data":"c755138303991c357840db3b215bad01a7d2d07ad65084023fd3619c992272e7"} Jun 14 22:52:45.264521 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.264440 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" event={"ID":"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4","Type":"ContainerStarted","Data":"f550466e698c217f9b7ab74104fc0dbc569c4aaceaab072d3e123e716594e516"} Jun 14 22:52:45.264521 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.264471 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" event={"ID":"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4","Type":"ContainerStarted","Data":"1bc766cbdb5e75a50a58e338ad232ddea16df1dcf6d0011a08c694374122438f"} Jun 14 22:52:45.265491 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.265473 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" event={"ID":"ea4e9010-ca54-4865-8950-309ad61f3352","Type":"ContainerStarted","Data":"29f237f7ace3a32dae4b42b40516a4137c962c6cab40817c85cc8466b4f5afff"} Jun 14 22:52:45.358534 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:45.358454 2568 scope.go:117] "RemoveContainer" containerID="0d1bebb80029f455ea64ecf96e6c7cb0224b7a7d9ae43e374d83236a57b76592" Jun 14 22:52:45.358682 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:45.358641 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-l6qgq_openshift-console-operator(89981dda-2420-42ba-9c6b-a2ca61f5b386)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" podUID="89981dda-2420-42ba-9c6b-a2ca61f5b386" Jun 14 22:52:47.276256 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.276167 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerStarted","Data":"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb"} Jun 14 22:52:47.278092 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.278066 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-55m9x" event={"ID":"21919e62-63b8-4c0b-af0c-7465e15fc018","Type":"ContainerStarted","Data":"0c52a2a356326c8bd697fa71c9590c1f8ad2c8a8074472e83be642a8aac4f30f"} Jun 14 22:52:47.278230 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.278109 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-55m9x" event={"ID":"21919e62-63b8-4c0b-af0c-7465e15fc018","Type":"ContainerStarted","Data":"31ce79516b32ab74867ce4a6348595b676eac52807d93eecfc0de392d86a6970"} Jun 14 22:52:47.278230 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.278164 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-55m9x" Jun 14 22:52:47.280788 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.280765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" event={"ID":"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4","Type":"ContainerStarted","Data":"63bac928e588450feb5429be87d08fd4a6350fcd0a39808b4549c70354179ccc"} Jun 14 22:52:47.280908 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.280826 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" event={"ID":"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4","Type":"ContainerStarted","Data":"3417dbc7533917388e76ac956d9c1d6f914e9932d7ba1148073e3964ca267a23"} Jun 14 22:52:47.280908 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.280870 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" event={"ID":"7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4","Type":"ContainerStarted","Data":"4667588b743822e5b6f6278a720298cae80512d1a06bc47168af6d89ccd8d1e5"} Jun 14 22:52:47.280997 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.280913 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:47.282221 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.282200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" event={"ID":"ea4e9010-ca54-4865-8950-309ad61f3352","Type":"ContainerStarted","Data":"1d480a5bbe8159178f958b0db04e95a5351947702c710f20f229e630881e0f08"} Jun 14 22:52:47.282403 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.282385 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:47.287057 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.287039 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" Jun 14 22:52:47.312888 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.312833 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.605508899 podStartE2EDuration="8.312816868s" totalImagesPullingTime="5.690008857s" totalInitContainerRuntime="17.299112ms" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:47.310939595 +0000 UTC m=+287.377322408" watchObservedRunningTime="2026-06-14 22:52:47.312816868 +0000 UTC m=+287.379199623" Jun 14 22:52:47.328229 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.328183 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-hf2dk" podStartSLOduration=2.32937017 podStartE2EDuration="4.328164743s" totalImagesPullingTime="1.998794573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:47.327868803 +0000 UTC m=+287.394251570" watchObservedRunningTime="2026-06-14 22:52:47.328164743 +0000 UTC m=+287.394547501" Jun 14 22:52:47.355417 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.355370 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" podStartSLOduration=2.1119967649999998 podStartE2EDuration="6.355354703s" totalImagesPullingTime="4.243357938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:47.354432708 +0000 UTC m=+287.420815478" watchObservedRunningTime="2026-06-14 22:52:47.355354703 +0000 UTC m=+287.421737457" Jun 14 22:52:47.372620 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:47.372573 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-55m9x" podStartSLOduration=251.616867448 podStartE2EDuration="4m13.372557834s" totalImagesPullingTime="1.755690386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:47.371192279 +0000 UTC m=+287.437575033" watchObservedRunningTime="2026-06-14 22:52:47.372557834 +0000 UTC m=+287.438940634" Jun 14 22:52:53.293648 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:53.293623 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-59bd89d576-7m542" Jun 14 22:52:56.359658 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:52:56.359618 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-pwqsb" podUID="af9ceced-b4ae-40c1-b7c0-77966f7a505d" Jun 14 22:52:57.289583 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:57.289554 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-55m9x" Jun 14 22:52:58.358725 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:58.358689 2568 scope.go:117] "RemoveContainer" containerID="0d1bebb80029f455ea64ecf96e6c7cb0224b7a7d9ae43e374d83236a57b76592" Jun 14 22:52:58.915013 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:58.914978 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-wxnc8"] Jun 14 22:52:58.918678 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:58.918644 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-wxnc8" Jun 14 22:52:58.921054 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:58.921029 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-njql2\"" Jun 14 22:52:58.921212 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:58.921059 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 14 22:52:58.921212 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:58.921088 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 14 22:52:58.926795 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:58.926773 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-wxnc8"] Jun 14 22:52:59.077963 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.077925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v89kz\" (UniqueName: \"kubernetes.io/projected/7e65d275-9791-4cad-b7b4-c5e35d418b4b-kube-api-access-v89kz\") pod \"downloads-694c955b9-wxnc8\" (UID: \"7e65d275-9791-4cad-b7b4-c5e35d418b4b\") " pod="openshift-console/downloads-694c955b9-wxnc8" Jun 14 22:52:59.178615 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.178586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v89kz\" (UniqueName: \"kubernetes.io/projected/7e65d275-9791-4cad-b7b4-c5e35d418b4b-kube-api-access-v89kz\") pod \"downloads-694c955b9-wxnc8\" (UID: \"7e65d275-9791-4cad-b7b4-c5e35d418b4b\") " pod="openshift-console/downloads-694c955b9-wxnc8" Jun 14 22:52:59.187024 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.186992 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v89kz\" (UniqueName: \"kubernetes.io/projected/7e65d275-9791-4cad-b7b4-c5e35d418b4b-kube-api-access-v89kz\") pod \"downloads-694c955b9-wxnc8\" (UID: \"7e65d275-9791-4cad-b7b4-c5e35d418b4b\") " pod="openshift-console/downloads-694c955b9-wxnc8" Jun 14 22:52:59.230018 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.229992 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-wxnc8" Jun 14 22:52:59.335352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.335250 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 22:52:59.335352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.335346 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" event={"ID":"89981dda-2420-42ba-9c6b-a2ca61f5b386","Type":"ContainerStarted","Data":"7cbcf693e48a17d059b5f99577d2cc5883f840311a00fcbe10d6a9547d0c2b74"} Jun 14 22:52:59.335666 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.335622 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:59.340897 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.340871 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" Jun 14 22:52:59.353339 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.353298 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-l6qgq" podStartSLOduration=54.490451693 podStartE2EDuration="57.353281882s" totalImagesPullingTime="2.862830189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:52:59.352070092 +0000 UTC m=+299.418452849" watchObservedRunningTime="2026-06-14 22:52:59.353281882 +0000 UTC m=+299.419664636" Jun 14 22:52:59.372979 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:52:59.372948 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-wxnc8"] Jun 14 22:52:59.375954 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:52:59.375926 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e65d275_9791_4cad_b7b4_c5e35d418b4b.slice/crio-e0f015c942960108a242be940464c8876d8af027dfed4078cd7072764bcb8424 WatchSource:0}: Error finding container e0f015c942960108a242be940464c8876d8af027dfed4078cd7072764bcb8424: Status 404 returned error can't find the container with id e0f015c942960108a242be940464c8876d8af027dfed4078cd7072764bcb8424 Jun 14 22:53:00.320509 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:00.320477 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 22:53:00.322357 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:00.322249 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 22:53:00.329979 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:00.329952 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:53:00.331470 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:00.331447 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:53:00.334864 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:00.334847 2568 kubelet.go:1648] "Image garbage collection succeeded" Jun 14 22:53:00.340632 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:00.340607 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-wxnc8" event={"ID":"7e65d275-9791-4cad-b7b4-c5e35d418b4b","Type":"ContainerStarted","Data":"e0f015c942960108a242be940464c8876d8af027dfed4078cd7072764bcb8424"} Jun 14 22:53:09.251807 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.251771 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9fbcddfdc-rrfb6"] Jun 14 22:53:09.257013 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.256989 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.259390 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.259366 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 14 22:53:09.260285 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.260261 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 14 22:53:09.260285 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.260278 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 14 22:53:09.260446 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.260327 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 14 22:53:09.260446 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.260430 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 14 22:53:09.260703 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.260599 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qw2ns\"" Jun 14 22:53:09.262926 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.262906 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9fbcddfdc-rrfb6"] Jun 14 22:53:09.376869 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.376783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-oauth-config\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.376869 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.376854 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-service-ca\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.377105 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.376900 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-serving-cert\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.377105 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.376965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-console-config\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.377105 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.377087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2pz2\" (UniqueName: \"kubernetes.io/projected/93d96779-92a3-4036-9901-6ef613a20145-kube-api-access-m2pz2\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.377262 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.377152 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-oauth-serving-cert\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.478118 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.478076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-console-config\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.478502 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.478475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2pz2\" (UniqueName: \"kubernetes.io/projected/93d96779-92a3-4036-9901-6ef613a20145-kube-api-access-m2pz2\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.478613 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.478551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-oauth-serving-cert\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.478613 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.478596 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-oauth-config\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.478727 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.478621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-service-ca\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.478962 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.478929 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-console-config\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.479036 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.478973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-serving-cert\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.479288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.479245 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-service-ca\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.479567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.479538 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-oauth-serving-cert\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.481564 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.481540 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-serving-cert\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.481564 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.481555 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-oauth-config\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.486251 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.486219 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2pz2\" (UniqueName: \"kubernetes.io/projected/93d96779-92a3-4036-9901-6ef613a20145-kube-api-access-m2pz2\") pod \"console-9fbcddfdc-rrfb6\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:09.569598 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:09.569519 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:10.360050 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:10.360020 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:53:14.964732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:14.964704 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9fbcddfdc-rrfb6"] Jun 14 22:53:14.966996 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:53:14.966968 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d96779_92a3_4036_9901_6ef613a20145.slice/crio-af46aa0c7b53f080792f91e32435be7a56eac031e014888c0bc8ec3a7bd942e9 WatchSource:0}: Error finding container af46aa0c7b53f080792f91e32435be7a56eac031e014888c0bc8ec3a7bd942e9: Status 404 returned error can't find the container with id af46aa0c7b53f080792f91e32435be7a56eac031e014888c0bc8ec3a7bd942e9 Jun 14 22:53:14.968842 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:14.968817 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:53:15.408605 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:15.408568 2568 generic.go:356] "Generic (PLEG): container finished" podID="21d8e7ab-6d4f-4410-8b6c-573ae00c5899" containerID="7be014dc625f14eb08815ec6722293eef4849539ff8daee80859ecbadf62356f" exitCode=0 Jun 14 22:53:15.408824 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:15.408654 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" event={"ID":"21d8e7ab-6d4f-4410-8b6c-573ae00c5899","Type":"ContainerDied","Data":"7be014dc625f14eb08815ec6722293eef4849539ff8daee80859ecbadf62356f"} Jun 14 22:53:15.409169 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:15.409147 2568 scope.go:117] "RemoveContainer" containerID="7be014dc625f14eb08815ec6722293eef4849539ff8daee80859ecbadf62356f" Jun 14 22:53:15.410261 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:15.410230 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fbcddfdc-rrfb6" event={"ID":"93d96779-92a3-4036-9901-6ef613a20145","Type":"ContainerStarted","Data":"af46aa0c7b53f080792f91e32435be7a56eac031e014888c0bc8ec3a7bd942e9"} Jun 14 22:53:15.412140 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:15.411990 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-wxnc8" event={"ID":"7e65d275-9791-4cad-b7b4-c5e35d418b4b","Type":"ContainerStarted","Data":"6cdf71dc3c0f8cbb4119d1c92c452aec2f69fe13baf517ebfc823615b09a9e79"} Jun 14 22:53:15.412391 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:15.412379 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-wxnc8" Jun 14 22:53:15.427885 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:15.427862 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-wxnc8" Jun 14 22:53:15.438849 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:15.437461 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-wxnc8" podStartSLOduration=1.856740858 podStartE2EDuration="17.437442303s" totalImagesPullingTime="15.580701445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:53:15.437229265 +0000 UTC m=+315.503612020" watchObservedRunningTime="2026-06-14 22:53:15.437442303 +0000 UTC m=+315.503825060" Jun 14 22:53:16.421188 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:16.420372 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-4jfph" event={"ID":"21d8e7ab-6d4f-4410-8b6c-573ae00c5899","Type":"ContainerStarted","Data":"5bc6025a9ba936346a7c50387f3bd08d27ef13f5d91486b13981e3daab18991d"} Jun 14 22:53:17.220541 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.220433 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7649cbbbc5-fnkmg"] Jun 14 22:53:17.247907 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.247867 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7649cbbbc5-fnkmg"] Jun 14 22:53:17.248773 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.247928 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.256776 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.256521 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 14 22:53:17.356136 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.356101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-oauth-config\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.356136 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.356141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-trusted-ca-bundle\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.356383 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.356170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-console-config\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.356383 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.356195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-service-ca\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.356383 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.356241 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-serving-cert\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.356383 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.356374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xbz\" (UniqueName: \"kubernetes.io/projected/88951442-9222-450d-a883-fd8660ec3598-kube-api-access-x6xbz\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.356572 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.356481 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-oauth-serving-cert\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.457107 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.457058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-oauth-config\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.457107 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.457105 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-trusted-ca-bundle\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.457732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.457133 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-console-config\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.457732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.457155 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-service-ca\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.457732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.457194 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-serving-cert\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.457732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.457316 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xbz\" (UniqueName: \"kubernetes.io/projected/88951442-9222-450d-a883-fd8660ec3598-kube-api-access-x6xbz\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.457732 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.457354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-oauth-serving-cert\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.458157 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.458132 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-oauth-serving-cert\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.459710 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.459083 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-console-config\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.459710 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.459366 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-trusted-ca-bundle\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.459710 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.459673 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-service-ca\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.460663 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.460639 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-oauth-config\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.463473 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.463436 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-serving-cert\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.466148 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.466124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xbz\" (UniqueName: \"kubernetes.io/projected/88951442-9222-450d-a883-fd8660ec3598-kube-api-access-x6xbz\") pod \"console-7649cbbbc5-fnkmg\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:17.562238 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:17.562145 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:18.506020 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:18.505990 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7649cbbbc5-fnkmg"] Jun 14 22:53:18.666039 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:53:18.665965 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88951442_9222_450d_a883_fd8660ec3598.slice/crio-99c870448c20a605c07881c01886f11c2e46b8dfe0ed98e9cfe814585f081ad5 WatchSource:0}: Error finding container 99c870448c20a605c07881c01886f11c2e46b8dfe0ed98e9cfe814585f081ad5: Status 404 returned error can't find the container with id 99c870448c20a605c07881c01886f11c2e46b8dfe0ed98e9cfe814585f081ad5 Jun 14 22:53:19.440492 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:19.440454 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fbcddfdc-rrfb6" event={"ID":"93d96779-92a3-4036-9901-6ef613a20145","Type":"ContainerStarted","Data":"f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71"} Jun 14 22:53:19.442448 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:19.442411 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7649cbbbc5-fnkmg" event={"ID":"88951442-9222-450d-a883-fd8660ec3598","Type":"ContainerStarted","Data":"1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425"} Jun 14 22:53:19.442598 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:19.442466 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7649cbbbc5-fnkmg" event={"ID":"88951442-9222-450d-a883-fd8660ec3598","Type":"ContainerStarted","Data":"99c870448c20a605c07881c01886f11c2e46b8dfe0ed98e9cfe814585f081ad5"} Jun 14 22:53:19.457729 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:19.457682 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9fbcddfdc-rrfb6" podStartSLOduration=6.729293806 podStartE2EDuration="10.457664488s" totalImagesPullingTime="3.728370682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:53:19.455986226 +0000 UTC m=+319.522369017" watchObservedRunningTime="2026-06-14 22:53:19.457664488 +0000 UTC m=+319.524047243" Jun 14 22:53:19.473063 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:19.473023 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7649cbbbc5-fnkmg" podStartSLOduration=2.473008696 podStartE2EDuration="2.473008696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:53:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:53:19.471273997 +0000 UTC m=+319.537656784" watchObservedRunningTime="2026-06-14 22:53:19.473008696 +0000 UTC m=+319.539391454" Jun 14 22:53:19.570689 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:19.570648 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:19.571159 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:19.570721 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:19.576270 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:19.576245 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:20.450797 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:20.450764 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:27.562986 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:27.562958 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:27.563549 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:27.563021 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:27.567662 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:27.567641 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:28.487355 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:28.487321 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:53:28.528609 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:28.528571 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9fbcddfdc-rrfb6"] Jun 14 22:53:36.515761 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:36.515710 2568 generic.go:356] "Generic (PLEG): container finished" podID="687dc1b0-719b-449b-8391-76a06e9a6e3c" containerID="672cba3f35632bc396a8a9ee5755d3076ec2c75c86c0033b845bf22079c30d36" exitCode=0 Jun 14 22:53:36.516160 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:36.515788 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" event={"ID":"687dc1b0-719b-449b-8391-76a06e9a6e3c","Type":"ContainerDied","Data":"672cba3f35632bc396a8a9ee5755d3076ec2c75c86c0033b845bf22079c30d36"} Jun 14 22:53:36.516600 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:36.516581 2568 scope.go:117] "RemoveContainer" containerID="672cba3f35632bc396a8a9ee5755d3076ec2c75c86c0033b845bf22079c30d36" Jun 14 22:53:37.521261 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:37.521225 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-x2h5d" event={"ID":"687dc1b0-719b-449b-8391-76a06e9a6e3c","Type":"ContainerStarted","Data":"2ea5a303e550beb8054a29c3b1d651ed34115d6e1fdcbdce47164cd0a4e9db57"} Jun 14 22:53:53.552252 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.552148 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9fbcddfdc-rrfb6" podUID="93d96779-92a3-4036-9901-6ef613a20145" containerName="console" containerID="cri-o://f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71" gracePeriod=15 Jun 14 22:53:53.829683 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.829622 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:53.878677 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.878651 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-console-config\") pod \"93d96779-92a3-4036-9901-6ef613a20145\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " Jun 14 22:53:53.878850 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.878690 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-serving-cert\") pod \"93d96779-92a3-4036-9901-6ef613a20145\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " Jun 14 22:53:53.878850 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.878709 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2pz2\" (UniqueName: \"kubernetes.io/projected/93d96779-92a3-4036-9901-6ef613a20145-kube-api-access-m2pz2\") pod \"93d96779-92a3-4036-9901-6ef613a20145\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " Jun 14 22:53:53.878850 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.878730 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-oauth-serving-cert\") pod \"93d96779-92a3-4036-9901-6ef613a20145\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " Jun 14 22:53:53.878850 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.878791 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-oauth-config\") pod \"93d96779-92a3-4036-9901-6ef613a20145\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " Jun 14 22:53:53.878850 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.878820 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-service-ca\") pod \"93d96779-92a3-4036-9901-6ef613a20145\" (UID: \"93d96779-92a3-4036-9901-6ef613a20145\") " Jun 14 22:53:53.879190 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.879163 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "93d96779-92a3-4036-9901-6ef613a20145" (UID: "93d96779-92a3-4036-9901-6ef613a20145"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:53:53.879389 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.879365 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-service-ca" (OuterVolumeSpecName: "service-ca") pod "93d96779-92a3-4036-9901-6ef613a20145" (UID: "93d96779-92a3-4036-9901-6ef613a20145"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:53:53.879522 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.879479 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-console-config" (OuterVolumeSpecName: "console-config") pod "93d96779-92a3-4036-9901-6ef613a20145" (UID: "93d96779-92a3-4036-9901-6ef613a20145"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:53:53.881139 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.881111 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "93d96779-92a3-4036-9901-6ef613a20145" (UID: "93d96779-92a3-4036-9901-6ef613a20145"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:53:53.881139 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.881134 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93d96779-92a3-4036-9901-6ef613a20145-kube-api-access-m2pz2" (OuterVolumeSpecName: "kube-api-access-m2pz2") pod "93d96779-92a3-4036-9901-6ef613a20145" (UID: "93d96779-92a3-4036-9901-6ef613a20145"). InnerVolumeSpecName "kube-api-access-m2pz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:53:53.881321 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.881166 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "93d96779-92a3-4036-9901-6ef613a20145" (UID: "93d96779-92a3-4036-9901-6ef613a20145"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:53:53.979891 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.979855 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-serving-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:53:53.979891 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.979879 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2pz2\" (UniqueName: \"kubernetes.io/projected/93d96779-92a3-4036-9901-6ef613a20145-kube-api-access-m2pz2\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:53:53.979891 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.979888 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-oauth-serving-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:53:53.979891 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.979897 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/93d96779-92a3-4036-9901-6ef613a20145-console-oauth-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:53:53.980134 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.979906 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-service-ca\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:53:53.980134 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:53.979915 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/93d96779-92a3-4036-9901-6ef613a20145-console-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:53:54.591592 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.591555 2568 generic.go:356] "Generic (PLEG): container finished" podID="93d96779-92a3-4036-9901-6ef613a20145" containerID="f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71" exitCode=0 Jun 14 22:53:54.592073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.591611 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9fbcddfdc-rrfb6" Jun 14 22:53:54.592073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.591643 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fbcddfdc-rrfb6" event={"ID":"93d96779-92a3-4036-9901-6ef613a20145","Type":"ContainerDied","Data":"f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71"} Jun 14 22:53:54.592073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.591706 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9fbcddfdc-rrfb6" event={"ID":"93d96779-92a3-4036-9901-6ef613a20145","Type":"ContainerDied","Data":"af46aa0c7b53f080792f91e32435be7a56eac031e014888c0bc8ec3a7bd942e9"} Jun 14 22:53:54.592073 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.591738 2568 scope.go:117] "RemoveContainer" containerID="f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71" Jun 14 22:53:54.600216 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.600201 2568 scope.go:117] "RemoveContainer" containerID="f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71" Jun 14 22:53:54.600461 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:53:54.600443 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71\": container with ID starting with f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71 not found: ID does not exist" containerID="f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71" Jun 14 22:53:54.600508 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.600467 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71"} err="failed to get container status \"f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71\": rpc error: code = NotFound desc = could not find container \"f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71\": container with ID starting with f4d9cbdd3bb28d945e4224a0d1ca4f0afbfdc625d409d77e5e92a5c841a89b71 not found: ID does not exist" Jun 14 22:53:54.606084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.606063 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9fbcddfdc-rrfb6"] Jun 14 22:53:54.611663 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:54.611640 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9fbcddfdc-rrfb6"] Jun 14 22:53:56.363405 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:56.363370 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93d96779-92a3-4036-9901-6ef613a20145" path="/var/lib/kubelet/pods/93d96779-92a3-4036-9901-6ef613a20145/volumes" Jun 14 22:53:58.740327 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:58.740291 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:53:58.740767 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:58.740565 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="alertmanager" containerID="cri-o://d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a" gracePeriod=120 Jun 14 22:53:58.740767 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:58.740657 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy-web" containerID="cri-o://89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b" gracePeriod=120 Jun 14 22:53:58.740767 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:58.740684 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="prom-label-proxy" containerID="cri-o://81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb" gracePeriod=120 Jun 14 22:53:58.740767 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:58.740678 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy" containerID="cri-o://1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339" gracePeriod=120 Jun 14 22:53:58.740767 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:58.740718 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="config-reloader" containerID="cri-o://bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a" gracePeriod=120 Jun 14 22:53:58.741045 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:58.740659 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy-metric" containerID="cri-o://89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d" gracePeriod=120 Jun 14 22:53:59.122733 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.122660 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6d465c49-xn78t"] Jun 14 22:53:59.123089 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.123070 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93d96779-92a3-4036-9901-6ef613a20145" containerName="console" Jun 14 22:53:59.123143 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.123093 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="93d96779-92a3-4036-9901-6ef613a20145" containerName="console" Jun 14 22:53:59.123180 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.123160 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="93d96779-92a3-4036-9901-6ef613a20145" containerName="console" Jun 14 22:53:59.134370 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.134351 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.152314 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.152280 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6d465c49-xn78t"] Jun 14 22:53:59.227105 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.227077 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-trusted-ca-bundle\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.227282 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.227137 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-oauth-serving-cert\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.227282 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.227200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-console-config\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.227282 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.227249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-serving-cert\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.227282 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.227267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-service-ca\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.227411 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.227287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk5js\" (UniqueName: \"kubernetes.io/projected/a343eb91-3408-4992-98be-a195f5ce7c62-kube-api-access-sk5js\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.227411 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.227351 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-oauth-config\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.328666 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.328633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk5js\" (UniqueName: \"kubernetes.io/projected/a343eb91-3408-4992-98be-a195f5ce7c62-kube-api-access-sk5js\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.328841 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.328685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-oauth-config\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.328841 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.328715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-trusted-ca-bundle\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.328841 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.328815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-oauth-serving-cert\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.328970 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.328851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-console-config\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.328970 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.328910 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-serving-cert\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.328970 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.328944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-service-ca\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.329680 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.329653 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-console-config\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.329822 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.329653 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-oauth-serving-cert\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.329822 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.329663 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-service-ca\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.329822 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.329772 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-trusted-ca-bundle\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.331223 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.331201 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-oauth-config\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.331438 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.331418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-serving-cert\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.335938 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.335917 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk5js\" (UniqueName: \"kubernetes.io/projected/a343eb91-3408-4992-98be-a195f5ce7c62-kube-api-access-sk5js\") pod \"console-5f6d465c49-xn78t\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.443125 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.443093 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:53:59.605861 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.605829 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6d465c49-xn78t"] Jun 14 22:53:59.609047 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:53:59.609024 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda343eb91_3408_4992_98be_a195f5ce7c62.slice/crio-4f5b875ac8f8a0cb454343ababa6ccdb945bf7ead435bd7e95f3fd24f04b6f2a WatchSource:0}: Error finding container 4f5b875ac8f8a0cb454343ababa6ccdb945bf7ead435bd7e95f3fd24f04b6f2a: Status 404 returned error can't find the container with id 4f5b875ac8f8a0cb454343ababa6ccdb945bf7ead435bd7e95f3fd24f04b6f2a Jun 14 22:53:59.615644 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.615622 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6d465c49-xn78t" event={"ID":"a343eb91-3408-4992-98be-a195f5ce7c62","Type":"ContainerStarted","Data":"4f5b875ac8f8a0cb454343ababa6ccdb945bf7ead435bd7e95f3fd24f04b6f2a"} Jun 14 22:53:59.621182 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.621153 2568 generic.go:356] "Generic (PLEG): container finished" podID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerID="81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb" exitCode=0 Jun 14 22:53:59.621182 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.621182 2568 generic.go:356] "Generic (PLEG): container finished" podID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerID="1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339" exitCode=0 Jun 14 22:53:59.621343 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.621191 2568 generic.go:356] "Generic (PLEG): container finished" podID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerID="bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a" exitCode=0 Jun 14 22:53:59.621343 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.621200 2568 generic.go:356] "Generic (PLEG): container finished" podID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerID="d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a" exitCode=0 Jun 14 22:53:59.621343 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.621233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerDied","Data":"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb"} Jun 14 22:53:59.621879 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.621350 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerDied","Data":"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339"} Jun 14 22:53:59.621879 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.621406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerDied","Data":"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a"} Jun 14 22:53:59.621879 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:53:59.621456 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerDied","Data":"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a"} Jun 14 22:54:00.012928 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.012899 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.035501 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035475 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-tls-assets\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.035610 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035507 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-trusted-ca-bundle\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.035610 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035547 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-web\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.035715 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035682 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-metrics-client-ca\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.035785 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035728 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-volume\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.035842 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035780 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r4dj\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-kube-api-access-7r4dj\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.035898 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035844 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-web-config\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.035898 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035873 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-out\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.036002 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.035967 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:00.036128 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.036086 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:00.037441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.036303 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-cluster-tls-config\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.037441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.036376 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.037441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.036407 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-main-db\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.037441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.036443 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.037441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.036471 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-main-tls\") pod \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\" (UID: \"7709ff4b-0f2a-4b2e-888f-7214fccd8339\") " Jun 14 22:54:00.037441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.036810 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.037441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.036830 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7709ff4b-0f2a-4b2e-888f-7214fccd8339-metrics-client-ca\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.037441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.037383 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:54:00.038590 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.038565 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:00.039700 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.039649 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:54:00.039821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.039785 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-volume" (OuterVolumeSpecName: "config-volume") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:00.039927 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.039894 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-out" (OuterVolumeSpecName: "config-out") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:54:00.040896 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.040855 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:00.041032 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.040999 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:00.041032 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.040870 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-kube-api-access-7r4dj" (OuterVolumeSpecName: "kube-api-access-7r4dj") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "kube-api-access-7r4dj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:54:00.041448 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.041422 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:00.045327 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.045290 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:00.052901 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.052868 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-web-config" (OuterVolumeSpecName: "web-config") pod "7709ff4b-0f2a-4b2e-888f-7214fccd8339" (UID: "7709ff4b-0f2a-4b2e-888f-7214fccd8339"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:00.137463 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137423 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137463 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137458 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-volume\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137463 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137469 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r4dj\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-kube-api-access-7r4dj\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137479 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-web-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137488 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-config-out\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137496 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-cluster-tls-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137504 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137513 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7709ff4b-0f2a-4b2e-888f-7214fccd8339-alertmanager-main-db\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137522 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137532 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7709ff4b-0f2a-4b2e-888f-7214fccd8339-secret-alertmanager-main-tls\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.137701 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.137540 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7709ff4b-0f2a-4b2e-888f-7214fccd8339-tls-assets\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:00.627333 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.627238 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6d465c49-xn78t" event={"ID":"a343eb91-3408-4992-98be-a195f5ce7c62","Type":"ContainerStarted","Data":"d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236"} Jun 14 22:54:00.630567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.630540 2568 generic.go:356] "Generic (PLEG): container finished" podID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerID="89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d" exitCode=0 Jun 14 22:54:00.630567 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.630566 2568 generic.go:356] "Generic (PLEG): container finished" podID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerID="89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b" exitCode=0 Jun 14 22:54:00.630796 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.630608 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.630796 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.630620 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerDied","Data":"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d"} Jun 14 22:54:00.630796 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.630694 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerDied","Data":"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b"} Jun 14 22:54:00.630796 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.630736 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7709ff4b-0f2a-4b2e-888f-7214fccd8339","Type":"ContainerDied","Data":"d68a9922f30b121cde382a2e0a37ddd63e6c3fb486bea70bb3cb6d5e9175229f"} Jun 14 22:54:00.630796 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.630773 2568 scope.go:117] "RemoveContainer" containerID="81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb" Jun 14 22:54:00.638384 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.638366 2568 scope.go:117] "RemoveContainer" containerID="89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d" Jun 14 22:54:00.643307 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.643268 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6d465c49-xn78t" podStartSLOduration=1.643253348 podStartE2EDuration="1.643253348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:53:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:54:00.642650238 +0000 UTC m=+360.709032996" watchObservedRunningTime="2026-06-14 22:54:00.643253348 +0000 UTC m=+360.709636101" Jun 14 22:54:00.645846 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.645829 2568 scope.go:117] "RemoveContainer" containerID="1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339" Jun 14 22:54:00.652595 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.652574 2568 scope.go:117] "RemoveContainer" containerID="89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b" Jun 14 22:54:00.659042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.659011 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:54:00.660670 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.660650 2568 scope.go:117] "RemoveContainer" containerID="bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a" Jun 14 22:54:00.662543 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.662524 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:54:00.668005 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.667991 2568 scope.go:117] "RemoveContainer" containerID="d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a" Jun 14 22:54:00.675119 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.675102 2568 scope.go:117] "RemoveContainer" containerID="293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78" Jun 14 22:54:00.684534 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.684009 2568 scope.go:117] "RemoveContainer" containerID="81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb" Jun 14 22:54:00.684534 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:54:00.684286 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb\": container with ID starting with 81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb not found: ID does not exist" containerID="81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb" Jun 14 22:54:00.684534 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.684316 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb"} err="failed to get container status \"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb\": rpc error: code = NotFound desc = could not find container \"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb\": container with ID starting with 81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb not found: ID does not exist" Jun 14 22:54:00.684534 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.684338 2568 scope.go:117] "RemoveContainer" containerID="89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d" Jun 14 22:54:00.684851 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:54:00.684553 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d\": container with ID starting with 89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d not found: ID does not exist" containerID="89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d" Jun 14 22:54:00.684851 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.684575 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d"} err="failed to get container status \"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d\": rpc error: code = NotFound desc = could not find container \"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d\": container with ID starting with 89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d not found: ID does not exist" Jun 14 22:54:00.684851 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.684592 2568 scope.go:117] "RemoveContainer" containerID="1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339" Jun 14 22:54:00.685211 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:54:00.685107 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339\": container with ID starting with 1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339 not found: ID does not exist" containerID="1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339" Jun 14 22:54:00.685211 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.685137 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339"} err="failed to get container status \"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339\": rpc error: code = NotFound desc = could not find container \"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339\": container with ID starting with 1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339 not found: ID does not exist" Jun 14 22:54:00.685211 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.685154 2568 scope.go:117] "RemoveContainer" containerID="89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b" Jun 14 22:54:00.685611 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.685577 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:54:00.685807 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:54:00.685579 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b\": container with ID starting with 89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b not found: ID does not exist" containerID="89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b" Jun 14 22:54:00.685807 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.685715 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b"} err="failed to get container status \"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b\": rpc error: code = NotFound desc = could not find container \"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b\": container with ID starting with 89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b not found: ID does not exist" Jun 14 22:54:00.685807 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.685736 2568 scope.go:117] "RemoveContainer" containerID="bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686056 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy-web" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686074 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy-web" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686086 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686094 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686106 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="config-reloader" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686114 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="config-reloader" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686129 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="alertmanager" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686137 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="alertmanager" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:54:00.686141 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a\": container with ID starting with bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a not found: ID does not exist" containerID="bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686166 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a"} err="failed to get container status \"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a\": rpc error: code = NotFound desc = could not find container \"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a\": container with ID starting with bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a not found: ID does not exist" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686183 2568 scope.go:117] "RemoveContainer" containerID="d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686148 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy-metric" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686240 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy-metric" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686264 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="init-config-reloader" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686273 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="init-config-reloader" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686295 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="prom-label-proxy" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686303 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="prom-label-proxy" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686411 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="config-reloader" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686422 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686431 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="prom-label-proxy" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686440 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy-web" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686448 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="alertmanager" Jun 14 22:54:00.686964 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.686457 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" containerName="kube-rbac-proxy-metric" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:54:00.687384 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a\": container with ID starting with d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a not found: ID does not exist" containerID="d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.687411 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a"} err="failed to get container status \"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a\": rpc error: code = NotFound desc = could not find container \"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a\": container with ID starting with d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a not found: ID does not exist" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.687429 2568 scope.go:117] "RemoveContainer" containerID="293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:54:00.687643 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78\": container with ID starting with 293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78 not found: ID does not exist" containerID="293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.687664 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78"} err="failed to get container status \"293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78\": rpc error: code = NotFound desc = could not find container \"293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78\": container with ID starting with 293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78 not found: ID does not exist" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.687682 2568 scope.go:117] "RemoveContainer" containerID="81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.687898 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb"} err="failed to get container status \"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb\": rpc error: code = NotFound desc = could not find container \"81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb\": container with ID starting with 81ae09826896c3ea542c3f425de39e7658799970361ee4886f9b9750fe18f3fb not found: ID does not exist" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.687916 2568 scope.go:117] "RemoveContainer" containerID="89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.688133 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d"} err="failed to get container status \"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d\": rpc error: code = NotFound desc = could not find container \"89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d\": container with ID starting with 89ac6d8abdf2af3dd2007e1ef62b051a410108ec96acd2afe47c9a3eb7d1ae9d not found: ID does not exist" Jun 14 22:54:00.689021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.688201 2568 scope.go:117] "RemoveContainer" containerID="1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339" Jun 14 22:54:00.689468 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.689038 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339"} err="failed to get container status \"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339\": rpc error: code = NotFound desc = could not find container \"1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339\": container with ID starting with 1d5b48e9a8b299e97bd52da7c399ffb6f6fda9ca7e04ed71be45e626a0ff8339 not found: ID does not exist" Jun 14 22:54:00.689468 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.689061 2568 scope.go:117] "RemoveContainer" containerID="89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b" Jun 14 22:54:00.689468 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.689370 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b"} err="failed to get container status \"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b\": rpc error: code = NotFound desc = could not find container \"89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b\": container with ID starting with 89dd14ef3b7ac778990c89f69b775c724dcc3f6167a5c103964b6da681a3a38b not found: ID does not exist" Jun 14 22:54:00.689468 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.689393 2568 scope.go:117] "RemoveContainer" containerID="bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a" Jun 14 22:54:00.689654 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.689633 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a"} err="failed to get container status \"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a\": rpc error: code = NotFound desc = could not find container \"bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a\": container with ID starting with bb6ae78ea02badeb592d80e7f365d1a36bc6c1ebbdec41e5095b05a95d6d5c6a not found: ID does not exist" Jun 14 22:54:00.689712 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.689658 2568 scope.go:117] "RemoveContainer" containerID="d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a" Jun 14 22:54:00.689989 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.689970 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a"} err="failed to get container status \"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a\": rpc error: code = NotFound desc = could not find container \"d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a\": container with ID starting with d5a9bf9c6efc91ab766df4a69dfedb1cfbd00a322603749bc00d94e28605966a not found: ID does not exist" Jun 14 22:54:00.690041 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.689989 2568 scope.go:117] "RemoveContainer" containerID="293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78" Jun 14 22:54:00.690198 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.690178 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78"} err="failed to get container status \"293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78\": rpc error: code = NotFound desc = could not find container \"293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78\": container with ID starting with 293cc114f8b0de84959396eb8a33c08478d7f6389f051f078a4eb7db37b8bf78 not found: ID does not exist" Jun 14 22:54:00.721947 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.721917 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:54:00.722061 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.722032 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.724297 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.724277 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 14 22:54:00.724455 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.724419 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 14 22:54:00.724455 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.724426 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 14 22:54:00.724455 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.724450 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 14 22:54:00.724707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.724496 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 14 22:54:00.724707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.724556 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ndnh4\"" Jun 14 22:54:00.724839 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.724779 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 14 22:54:00.724942 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.724925 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 14 22:54:00.725026 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.725008 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 14 22:54:00.733668 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.733647 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 14 22:54:00.742127 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.741978 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742225 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caa4ef45-29d4-4929-93eb-9803cf2a9766-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742280 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-config-volume\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742280 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742272 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa4ef45-29d4-4929-93eb-9803cf2a9766-config-out\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742453 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742544 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-web-config\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742544 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa4ef45-29d4-4929-93eb-9803cf2a9766-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742803 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db2ws\" (UniqueName: \"kubernetes.io/projected/caa4ef45-29d4-4929-93eb-9803cf2a9766-kube-api-access-db2ws\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742902 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa4ef45-29d4-4929-93eb-9803cf2a9766-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742902 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742847 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.742902 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742891 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa4ef45-29d4-4929-93eb-9803cf2a9766-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.743131 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.742930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.743131 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.743008 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.843632 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.843605 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.843790 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.843648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caa4ef45-29d4-4929-93eb-9803cf2a9766-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.843790 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.843665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-config-volume\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.843790 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.843683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa4ef45-29d4-4929-93eb-9803cf2a9766-config-out\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.843790 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.843704 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.843790 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.843723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-web-config\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.844035 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.843892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa4ef45-29d4-4929-93eb-9803cf2a9766-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.844118 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.844093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caa4ef45-29d4-4929-93eb-9803cf2a9766-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.844379 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.844022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db2ws\" (UniqueName: \"kubernetes.io/projected/caa4ef45-29d4-4929-93eb-9803cf2a9766-kube-api-access-db2ws\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.844585 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.844559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa4ef45-29d4-4929-93eb-9803cf2a9766-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.844682 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.844601 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.844682 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.844647 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa4ef45-29d4-4929-93eb-9803cf2a9766-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.844827 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.844697 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.844827 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.844739 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.845122 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.844600 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa4ef45-29d4-4929-93eb-9803cf2a9766-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.845650 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.845623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa4ef45-29d4-4929-93eb-9803cf2a9766-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.846968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.846735 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa4ef45-29d4-4929-93eb-9803cf2a9766-config-out\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.846968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.846888 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.847102 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.847040 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-web-config\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.847181 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.847159 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-config-volume\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.847632 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.847604 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.847823 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.847798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.847925 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.847865 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.848129 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.848106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa4ef45-29d4-4929-93eb-9803cf2a9766-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.848764 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.848725 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caa4ef45-29d4-4929-93eb-9803cf2a9766-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:00.851368 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:00.851352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db2ws\" (UniqueName: \"kubernetes.io/projected/caa4ef45-29d4-4929-93eb-9803cf2a9766-kube-api-access-db2ws\") pod \"alertmanager-main-0\" (UID: \"caa4ef45-29d4-4929-93eb-9803cf2a9766\") " pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:01.034737 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:01.034711 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 14 22:54:01.194408 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:01.194385 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 14 22:54:01.195334 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:54:01.195311 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa4ef45_29d4_4929_93eb_9803cf2a9766.slice/crio-f28f5d6e5c1e007ce8636eccad17a92c4567297400ff4e652d3584f8e25588bf WatchSource:0}: Error finding container f28f5d6e5c1e007ce8636eccad17a92c4567297400ff4e652d3584f8e25588bf: Status 404 returned error can't find the container with id f28f5d6e5c1e007ce8636eccad17a92c4567297400ff4e652d3584f8e25588bf Jun 14 22:54:01.636983 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:01.636891 2568 generic.go:356] "Generic (PLEG): container finished" podID="caa4ef45-29d4-4929-93eb-9803cf2a9766" containerID="b68a24bee4da3681e100092e580ebc5549da3925397bf7988b02af85f5d053cd" exitCode=0 Jun 14 22:54:01.636983 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:01.636975 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa4ef45-29d4-4929-93eb-9803cf2a9766","Type":"ContainerDied","Data":"b68a24bee4da3681e100092e580ebc5549da3925397bf7988b02af85f5d053cd"} Jun 14 22:54:01.637192 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:01.637040 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa4ef45-29d4-4929-93eb-9803cf2a9766","Type":"ContainerStarted","Data":"f28f5d6e5c1e007ce8636eccad17a92c4567297400ff4e652d3584f8e25588bf"} Jun 14 22:54:02.363157 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:02.363133 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7709ff4b-0f2a-4b2e-888f-7214fccd8339" path="/var/lib/kubelet/pods/7709ff4b-0f2a-4b2e-888f-7214fccd8339/volumes" Jun 14 22:54:02.645619 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:02.645581 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa4ef45-29d4-4929-93eb-9803cf2a9766","Type":"ContainerStarted","Data":"42582af0bd0f27379327f5a6f75439f75d6b14b1f26e2c13726cdb92c17e51cf"} Jun 14 22:54:02.645810 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:02.645659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa4ef45-29d4-4929-93eb-9803cf2a9766","Type":"ContainerStarted","Data":"51aeafcb76196ac1601cdca3ced2376e30e42c850a6b5908cfbef6fc136bdd43"} Jun 14 22:54:02.645810 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:02.645702 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa4ef45-29d4-4929-93eb-9803cf2a9766","Type":"ContainerStarted","Data":"b1a6ed4d9e057195fb5b692394167092c5d29785fffa7285b8a7d31940773382"} Jun 14 22:54:02.645810 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:02.645765 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa4ef45-29d4-4929-93eb-9803cf2a9766","Type":"ContainerStarted","Data":"cc771aca566315a084dca00647c817ed8cf339227b2919777fc46ee56d09e678"} Jun 14 22:54:02.645810 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:02.645803 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa4ef45-29d4-4929-93eb-9803cf2a9766","Type":"ContainerStarted","Data":"f6c1cca2dbdbeae00d9bfbd28e61b6a72bdadb99995ed53ab83fb31b5a4b9b52"} Jun 14 22:54:02.645976 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:02.645839 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa4ef45-29d4-4929-93eb-9803cf2a9766","Type":"ContainerStarted","Data":"99a81fb74fcd50fd6df966f59c3b8881038d0e808da1828bdcb7b09dd4806cbf"} Jun 14 22:54:02.669179 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:02.669133 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.649118908 podStartE2EDuration="2.669118439s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.999531ms" isStatefulPod=false podCreationTimestamp="2026-06-14 22:54:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:54:02.66715048 +0000 UTC m=+362.733533235" watchObservedRunningTime="2026-06-14 22:54:02.669118439 +0000 UTC m=+362.735501219" Jun 14 22:54:09.443667 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:09.443625 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:54:09.444299 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:09.443704 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:54:09.448277 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:09.448255 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:54:09.687894 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:09.687860 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:54:09.729891 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:09.729814 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7649cbbbc5-fnkmg"] Jun 14 22:54:14.257985 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:14.257947 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:54:14.260208 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:14.260178 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af9ceced-b4ae-40c1-b7c0-77966f7a505d-metrics-certs\") pod \"network-metrics-daemon-pwqsb\" (UID: \"af9ceced-b4ae-40c1-b7c0-77966f7a505d\") " pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:54:14.263878 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:14.263862 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k6g9m\"" Jun 14 22:54:14.271811 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:14.271792 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-pwqsb" Jun 14 22:54:14.414269 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:14.414242 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-pwqsb"] Jun 14 22:54:14.416371 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:54:14.416337 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf9ceced_b4ae_40c1_b7c0_77966f7a505d.slice/crio-9bf9fbd87dfb826f8646fd83297a50e52159da5733e575e294db92e472f25c3b WatchSource:0}: Error finding container 9bf9fbd87dfb826f8646fd83297a50e52159da5733e575e294db92e472f25c3b: Status 404 returned error can't find the container with id 9bf9fbd87dfb826f8646fd83297a50e52159da5733e575e294db92e472f25c3b Jun 14 22:54:14.703371 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:14.703332 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pwqsb" event={"ID":"af9ceced-b4ae-40c1-b7c0-77966f7a505d","Type":"ContainerStarted","Data":"9bf9fbd87dfb826f8646fd83297a50e52159da5733e575e294db92e472f25c3b"} Jun 14 22:54:15.709723 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:15.709687 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pwqsb" event={"ID":"af9ceced-b4ae-40c1-b7c0-77966f7a505d","Type":"ContainerStarted","Data":"ad1a5a388a65202e572202c0ae80a40e3168719fe0a0a0d05a49a1e1a6816388"} Jun 14 22:54:15.710181 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:15.709739 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-pwqsb" event={"ID":"af9ceced-b4ae-40c1-b7c0-77966f7a505d","Type":"ContainerStarted","Data":"5e26def485e527706de615ec4938502bccf70c4b7ccd1ae116423a78dfe39a9b"} Jun 14 22:54:15.724985 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:15.724933 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-pwqsb" podStartSLOduration=374.959368401 podStartE2EDuration="6m15.724918486s" totalImagesPullingTime="765.550085ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:48:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:54:15.723666499 +0000 UTC m=+375.790049265" watchObservedRunningTime="2026-06-14 22:54:15.724918486 +0000 UTC m=+375.791301239" Jun 14 22:54:34.760440 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:34.760396 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7649cbbbc5-fnkmg" podUID="88951442-9222-450d-a883-fd8660ec3598" containerName="console" containerID="cri-o://1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425" gracePeriod=15 Jun 14 22:54:35.006067 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.006040 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:54:35.034365 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034301 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-trusted-ca-bundle\") pod \"88951442-9222-450d-a883-fd8660ec3598\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " Jun 14 22:54:35.034365 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034329 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-service-ca\") pod \"88951442-9222-450d-a883-fd8660ec3598\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " Jun 14 22:54:35.034566 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034374 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-serving-cert\") pod \"88951442-9222-450d-a883-fd8660ec3598\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " Jun 14 22:54:35.034566 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034400 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-console-config\") pod \"88951442-9222-450d-a883-fd8660ec3598\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " Jun 14 22:54:35.034566 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034422 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6xbz\" (UniqueName: \"kubernetes.io/projected/88951442-9222-450d-a883-fd8660ec3598-kube-api-access-x6xbz\") pod \"88951442-9222-450d-a883-fd8660ec3598\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " Jun 14 22:54:35.034566 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034454 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-oauth-serving-cert\") pod \"88951442-9222-450d-a883-fd8660ec3598\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " Jun 14 22:54:35.034566 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034489 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-oauth-config\") pod \"88951442-9222-450d-a883-fd8660ec3598\" (UID: \"88951442-9222-450d-a883-fd8660ec3598\") " Jun 14 22:54:35.034872 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034840 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "88951442-9222-450d-a883-fd8660ec3598" (UID: "88951442-9222-450d-a883-fd8660ec3598"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:35.034955 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034929 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-console-config" (OuterVolumeSpecName: "console-config") pod "88951442-9222-450d-a883-fd8660ec3598" (UID: "88951442-9222-450d-a883-fd8660ec3598"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:35.035026 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.034992 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "88951442-9222-450d-a883-fd8660ec3598" (UID: "88951442-9222-450d-a883-fd8660ec3598"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:35.035228 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.035204 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-service-ca" (OuterVolumeSpecName: "service-ca") pod "88951442-9222-450d-a883-fd8660ec3598" (UID: "88951442-9222-450d-a883-fd8660ec3598"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:54:35.036708 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.036676 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88951442-9222-450d-a883-fd8660ec3598-kube-api-access-x6xbz" (OuterVolumeSpecName: "kube-api-access-x6xbz") pod "88951442-9222-450d-a883-fd8660ec3598" (UID: "88951442-9222-450d-a883-fd8660ec3598"). InnerVolumeSpecName "kube-api-access-x6xbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:54:35.036821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.036715 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "88951442-9222-450d-a883-fd8660ec3598" (UID: "88951442-9222-450d-a883-fd8660ec3598"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:35.037196 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.037168 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "88951442-9222-450d-a883-fd8660ec3598" (UID: "88951442-9222-450d-a883-fd8660ec3598"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:54:35.135301 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.135267 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-oauth-serving-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:35.135301 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.135295 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-oauth-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:35.135301 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.135306 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-trusted-ca-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:35.135499 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.135315 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-service-ca\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:35.135499 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.135324 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/88951442-9222-450d-a883-fd8660ec3598-console-serving-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:35.135499 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.135332 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/88951442-9222-450d-a883-fd8660ec3598-console-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:35.135499 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.135341 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6xbz\" (UniqueName: \"kubernetes.io/projected/88951442-9222-450d-a883-fd8660ec3598-kube-api-access-x6xbz\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:54:35.799021 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.798985 2568 generic.go:356] "Generic (PLEG): container finished" podID="88951442-9222-450d-a883-fd8660ec3598" containerID="1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425" exitCode=0 Jun 14 22:54:35.799456 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.799041 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7649cbbbc5-fnkmg" event={"ID":"88951442-9222-450d-a883-fd8660ec3598","Type":"ContainerDied","Data":"1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425"} Jun 14 22:54:35.799456 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.799045 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7649cbbbc5-fnkmg" Jun 14 22:54:35.799456 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.799082 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7649cbbbc5-fnkmg" event={"ID":"88951442-9222-450d-a883-fd8660ec3598","Type":"ContainerDied","Data":"99c870448c20a605c07881c01886f11c2e46b8dfe0ed98e9cfe814585f081ad5"} Jun 14 22:54:35.799456 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.799101 2568 scope.go:117] "RemoveContainer" containerID="1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425" Jun 14 22:54:35.807966 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.807950 2568 scope.go:117] "RemoveContainer" containerID="1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425" Jun 14 22:54:35.808207 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:54:35.808191 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425\": container with ID starting with 1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425 not found: ID does not exist" containerID="1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425" Jun 14 22:54:35.808248 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.808216 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425"} err="failed to get container status \"1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425\": rpc error: code = NotFound desc = could not find container \"1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425\": container with ID starting with 1bca15a6506f82e92adbaf359ec3cfd4e02cf582c7d07cbd97705ea396579425 not found: ID does not exist" Jun 14 22:54:35.818681 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.818659 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7649cbbbc5-fnkmg"] Jun 14 22:54:35.821861 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:35.821840 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7649cbbbc5-fnkmg"] Jun 14 22:54:36.363687 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:36.363657 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88951442-9222-450d-a883-fd8660ec3598" path="/var/lib/kubelet/pods/88951442-9222-450d-a883-fd8660ec3598/volumes" Jun 14 22:54:41.135369 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.135336 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq"] Jun 14 22:54:41.135849 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.135653 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88951442-9222-450d-a883-fd8660ec3598" containerName="console" Jun 14 22:54:41.135849 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.135664 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="88951442-9222-450d-a883-fd8660ec3598" containerName="console" Jun 14 22:54:41.135849 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.135735 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="88951442-9222-450d-a883-fd8660ec3598" containerName="console" Jun 14 22:54:41.138536 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.138519 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.140883 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.140857 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 22:54:41.141690 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.141673 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v4tk7\"" Jun 14 22:54:41.141794 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.141772 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 22:54:41.147819 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.147786 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq"] Jun 14 22:54:41.180759 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.180725 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.180909 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.180839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.180909 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.180874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ncn9\" (UniqueName: \"kubernetes.io/projected/612f885a-8b77-401e-8c59-bb4284978c08-kube-api-access-4ncn9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.282030 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.281992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.282198 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.282038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ncn9\" (UniqueName: \"kubernetes.io/projected/612f885a-8b77-401e-8c59-bb4284978c08-kube-api-access-4ncn9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.282198 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.282114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.282471 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.282448 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.282512 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.282459 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.289976 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.289950 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ncn9\" (UniqueName: \"kubernetes.io/projected/612f885a-8b77-401e-8c59-bb4284978c08-kube-api-access-4ncn9\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.449359 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.449330 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:54:41.575790 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.575765 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq"] Jun 14 22:54:41.577974 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:54:41.577945 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612f885a_8b77_401e_8c59_bb4284978c08.slice/crio-126a8c42d64b24618ae0ec71cc074082ba505c6f4b94237f36548ffa4676be11 WatchSource:0}: Error finding container 126a8c42d64b24618ae0ec71cc074082ba505c6f4b94237f36548ffa4676be11: Status 404 returned error can't find the container with id 126a8c42d64b24618ae0ec71cc074082ba505c6f4b94237f36548ffa4676be11 Jun 14 22:54:41.825858 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:41.825776 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" event={"ID":"612f885a-8b77-401e-8c59-bb4284978c08","Type":"ContainerStarted","Data":"126a8c42d64b24618ae0ec71cc074082ba505c6f4b94237f36548ffa4676be11"} Jun 14 22:54:46.851352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:46.851318 2568 generic.go:356] "Generic (PLEG): container finished" podID="612f885a-8b77-401e-8c59-bb4284978c08" containerID="839bf049ccb307c692381464c13131aa26c93f625f5000b442ddc09f9b77fd3a" exitCode=0 Jun 14 22:54:46.851718 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:46.851402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" event={"ID":"612f885a-8b77-401e-8c59-bb4284978c08","Type":"ContainerDied","Data":"839bf049ccb307c692381464c13131aa26c93f625f5000b442ddc09f9b77fd3a"} Jun 14 22:54:51.877291 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:51.877258 2568 generic.go:356] "Generic (PLEG): container finished" podID="612f885a-8b77-401e-8c59-bb4284978c08" containerID="ea4e133319d498b19e35c6ffbf677978d101c3b71314bb3cde931f95d94e44de" exitCode=0 Jun 14 22:54:51.877782 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:51.877344 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" event={"ID":"612f885a-8b77-401e-8c59-bb4284978c08","Type":"ContainerDied","Data":"ea4e133319d498b19e35c6ffbf677978d101c3b71314bb3cde931f95d94e44de"} Jun 14 22:54:58.917452 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:58.917409 2568 generic.go:356] "Generic (PLEG): container finished" podID="612f885a-8b77-401e-8c59-bb4284978c08" containerID="4b7c51f8ee4a4bf90bcc8958df558269aa2f750635799a5ecd163f4826f3b839" exitCode=0 Jun 14 22:54:58.917854 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:54:58.917450 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" event={"ID":"612f885a-8b77-401e-8c59-bb4284978c08","Type":"ContainerDied","Data":"4b7c51f8ee4a4bf90bcc8958df558269aa2f750635799a5ecd163f4826f3b839"} Jun 14 22:55:00.050025 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.050001 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:55:00.145879 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.145847 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ncn9\" (UniqueName: \"kubernetes.io/projected/612f885a-8b77-401e-8c59-bb4284978c08-kube-api-access-4ncn9\") pod \"612f885a-8b77-401e-8c59-bb4284978c08\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " Jun 14 22:55:00.146043 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.145918 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-util\") pod \"612f885a-8b77-401e-8c59-bb4284978c08\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " Jun 14 22:55:00.146043 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.145983 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-bundle\") pod \"612f885a-8b77-401e-8c59-bb4284978c08\" (UID: \"612f885a-8b77-401e-8c59-bb4284978c08\") " Jun 14 22:55:00.146624 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.146595 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-bundle" (OuterVolumeSpecName: "bundle") pod "612f885a-8b77-401e-8c59-bb4284978c08" (UID: "612f885a-8b77-401e-8c59-bb4284978c08"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:55:00.148317 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.148290 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/612f885a-8b77-401e-8c59-bb4284978c08-kube-api-access-4ncn9" (OuterVolumeSpecName: "kube-api-access-4ncn9") pod "612f885a-8b77-401e-8c59-bb4284978c08" (UID: "612f885a-8b77-401e-8c59-bb4284978c08"). InnerVolumeSpecName "kube-api-access-4ncn9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:55:00.149872 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.149850 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-util" (OuterVolumeSpecName: "util") pod "612f885a-8b77-401e-8c59-bb4284978c08" (UID: "612f885a-8b77-401e-8c59-bb4284978c08"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:55:00.247502 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.247473 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:55:00.247502 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.247498 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ncn9\" (UniqueName: \"kubernetes.io/projected/612f885a-8b77-401e-8c59-bb4284978c08-kube-api-access-4ncn9\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:55:00.247502 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.247509 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/612f885a-8b77-401e-8c59-bb4284978c08-util\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:55:00.927851 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.927812 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" event={"ID":"612f885a-8b77-401e-8c59-bb4284978c08","Type":"ContainerDied","Data":"126a8c42d64b24618ae0ec71cc074082ba505c6f4b94237f36548ffa4676be11"} Jun 14 22:55:00.928010 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.927861 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkvfzq" Jun 14 22:55:00.928010 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:00.927869 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="126a8c42d64b24618ae0ec71cc074082ba505c6f4b94237f36548ffa4676be11" Jun 14 22:55:03.969120 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.969083 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77"] Jun 14 22:55:03.969609 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.969402 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="612f885a-8b77-401e-8c59-bb4284978c08" containerName="extract" Jun 14 22:55:03.969609 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.969414 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="612f885a-8b77-401e-8c59-bb4284978c08" containerName="extract" Jun 14 22:55:03.969609 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.969427 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="612f885a-8b77-401e-8c59-bb4284978c08" containerName="pull" Jun 14 22:55:03.969609 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.969435 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="612f885a-8b77-401e-8c59-bb4284978c08" containerName="pull" Jun 14 22:55:03.969609 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.969462 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="612f885a-8b77-401e-8c59-bb4284978c08" containerName="util" Jun 14 22:55:03.969609 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.969468 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="612f885a-8b77-401e-8c59-bb4284978c08" containerName="util" Jun 14 22:55:03.969609 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.969529 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="612f885a-8b77-401e-8c59-bb4284978c08" containerName="extract" Jun 14 22:55:03.975188 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.975168 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" Jun 14 22:55:03.978439 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.978417 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:55:03.978603 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.978586 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-64xjz\"" Jun 14 22:55:03.978652 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.978623 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 14 22:55:03.986317 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:03.986287 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77"] Jun 14 22:55:04.078190 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.078158 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2jb77\" (UID: \"0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" Jun 14 22:55:04.078371 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.078196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtjpb\" (UniqueName: \"kubernetes.io/projected/0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde-kube-api-access-mtjpb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2jb77\" (UID: \"0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" Jun 14 22:55:04.178920 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.178887 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2jb77\" (UID: \"0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" Jun 14 22:55:04.178920 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.178925 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtjpb\" (UniqueName: \"kubernetes.io/projected/0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde-kube-api-access-mtjpb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2jb77\" (UID: \"0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" Jun 14 22:55:04.179315 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.179297 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2jb77\" (UID: \"0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" Jun 14 22:55:04.191794 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.191773 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtjpb\" (UniqueName: \"kubernetes.io/projected/0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde-kube-api-access-mtjpb\") pod \"cert-manager-operator-controller-manager-57757f7cfc-2jb77\" (UID: \"0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" Jun 14 22:55:04.284287 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.284204 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" Jun 14 22:55:04.419451 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.419419 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77"] Jun 14 22:55:04.423611 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:55:04.423570 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1990e5_d23c_4fc9_9d74_0d3a9aa32cde.slice/crio-b65ec7d6aff33b71f2370f45b932946baf027017245d464e6ea61038defa6bf7 WatchSource:0}: Error finding container b65ec7d6aff33b71f2370f45b932946baf027017245d464e6ea61038defa6bf7: Status 404 returned error can't find the container with id b65ec7d6aff33b71f2370f45b932946baf027017245d464e6ea61038defa6bf7 Jun 14 22:55:04.945581 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:04.945551 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" event={"ID":"0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde","Type":"ContainerStarted","Data":"b65ec7d6aff33b71f2370f45b932946baf027017245d464e6ea61038defa6bf7"} Jun 14 22:55:06.958210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:06.958119 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" event={"ID":"0b1990e5-d23c-4fc9-9d74-0d3a9aa32cde","Type":"ContainerStarted","Data":"302a4d1a8eed374ebb9c2d501f1a1938d2190d87d8533fa2a8abb3336eeb58aa"} Jun 14 22:55:06.980168 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:06.980119 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-2jb77" podStartSLOduration=1.715237653 podStartE2EDuration="3.980104697s" totalImagesPullingTime="2.264867044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:06.977798347 +0000 UTC m=+427.044181122" watchObservedRunningTime="2026-06-14 22:55:06.980104697 +0000 UTC m=+427.046487451" Jun 14 22:55:12.700283 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.700251 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2"] Jun 14 22:55:12.702517 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.702501 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" Jun 14 22:55:12.705195 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.705173 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-mrnxj\"" Jun 14 22:55:12.705949 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.705935 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 14 22:55:12.706034 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.705965 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 14 22:55:12.712851 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.712830 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2"] Jun 14 22:55:12.857123 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.857086 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx462\" (UniqueName: \"kubernetes.io/projected/1910fb40-546d-47b2-a061-52cb7f4c673c-kube-api-access-gx462\") pod \"cert-manager-cainjector-5d99449ffd-mv6x2\" (UID: \"1910fb40-546d-47b2-a061-52cb7f4c673c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" Jun 14 22:55:12.857288 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.857139 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1910fb40-546d-47b2-a061-52cb7f4c673c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mv6x2\" (UID: \"1910fb40-546d-47b2-a061-52cb7f4c673c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" Jun 14 22:55:12.958500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.958402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1910fb40-546d-47b2-a061-52cb7f4c673c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mv6x2\" (UID: \"1910fb40-546d-47b2-a061-52cb7f4c673c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" Jun 14 22:55:12.958500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.958492 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx462\" (UniqueName: \"kubernetes.io/projected/1910fb40-546d-47b2-a061-52cb7f4c673c-kube-api-access-gx462\") pod \"cert-manager-cainjector-5d99449ffd-mv6x2\" (UID: \"1910fb40-546d-47b2-a061-52cb7f4c673c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" Jun 14 22:55:12.966266 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.966235 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1910fb40-546d-47b2-a061-52cb7f4c673c-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-mv6x2\" (UID: \"1910fb40-546d-47b2-a061-52cb7f4c673c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" Jun 14 22:55:12.966392 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:12.966337 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx462\" (UniqueName: \"kubernetes.io/projected/1910fb40-546d-47b2-a061-52cb7f4c673c-kube-api-access-gx462\") pod \"cert-manager-cainjector-5d99449ffd-mv6x2\" (UID: \"1910fb40-546d-47b2-a061-52cb7f4c673c\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" Jun 14 22:55:13.021830 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:13.021800 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" Jun 14 22:55:13.169025 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:13.169000 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2"] Jun 14 22:55:13.171757 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:55:13.171704 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1910fb40_546d_47b2_a061_52cb7f4c673c.slice/crio-4be70b78784ab944244af8cf2f54523cfe8432a3791db63e04a7e71cb08f6c5f WatchSource:0}: Error finding container 4be70b78784ab944244af8cf2f54523cfe8432a3791db63e04a7e71cb08f6c5f: Status 404 returned error can't find the container with id 4be70b78784ab944244af8cf2f54523cfe8432a3791db63e04a7e71cb08f6c5f Jun 14 22:55:13.990905 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:13.990869 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" event={"ID":"1910fb40-546d-47b2-a061-52cb7f4c673c","Type":"ContainerStarted","Data":"4be70b78784ab944244af8cf2f54523cfe8432a3791db63e04a7e71cb08f6c5f"} Jun 14 22:55:16.001176 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:16.001142 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" event={"ID":"1910fb40-546d-47b2-a061-52cb7f4c673c","Type":"ContainerStarted","Data":"487929dbc65bec6e9cc213da53441a04c0fa52d4016486e22443a2f71086aa8f"} Jun 14 22:55:16.016390 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:16.016339 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-mv6x2" podStartSLOduration=1.346122679 podStartE2EDuration="4.016323334s" totalImagesPullingTime="2.670200655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:16.014903755 +0000 UTC m=+436.081286510" watchObservedRunningTime="2026-06-14 22:55:16.016323334 +0000 UTC m=+436.082706087" Jun 14 22:55:18.769681 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:18.769598 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-x6jkd"] Jun 14 22:55:18.771698 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:18.771678 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-x6jkd" Jun 14 22:55:18.774013 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:18.773992 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tlpvg\"" Jun 14 22:55:18.782071 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:18.782050 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-x6jkd"] Jun 14 22:55:18.909308 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:18.909274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2c2db1d-2c93-4c38-b04e-35394136ead1-bound-sa-token\") pod \"cert-manager-59c77684cc-x6jkd\" (UID: \"b2c2db1d-2c93-4c38-b04e-35394136ead1\") " pod="cert-manager/cert-manager-59c77684cc-x6jkd" Jun 14 22:55:18.909488 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:18.909316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xw6t\" (UniqueName: \"kubernetes.io/projected/b2c2db1d-2c93-4c38-b04e-35394136ead1-kube-api-access-5xw6t\") pod \"cert-manager-59c77684cc-x6jkd\" (UID: \"b2c2db1d-2c93-4c38-b04e-35394136ead1\") " pod="cert-manager/cert-manager-59c77684cc-x6jkd" Jun 14 22:55:19.010296 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:19.010261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2c2db1d-2c93-4c38-b04e-35394136ead1-bound-sa-token\") pod \"cert-manager-59c77684cc-x6jkd\" (UID: \"b2c2db1d-2c93-4c38-b04e-35394136ead1\") " pod="cert-manager/cert-manager-59c77684cc-x6jkd" Jun 14 22:55:19.010296 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:19.010299 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xw6t\" (UniqueName: \"kubernetes.io/projected/b2c2db1d-2c93-4c38-b04e-35394136ead1-kube-api-access-5xw6t\") pod \"cert-manager-59c77684cc-x6jkd\" (UID: \"b2c2db1d-2c93-4c38-b04e-35394136ead1\") " pod="cert-manager/cert-manager-59c77684cc-x6jkd" Jun 14 22:55:19.017897 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:19.017867 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2c2db1d-2c93-4c38-b04e-35394136ead1-bound-sa-token\") pod \"cert-manager-59c77684cc-x6jkd\" (UID: \"b2c2db1d-2c93-4c38-b04e-35394136ead1\") " pod="cert-manager/cert-manager-59c77684cc-x6jkd" Jun 14 22:55:19.018081 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:19.017937 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xw6t\" (UniqueName: \"kubernetes.io/projected/b2c2db1d-2c93-4c38-b04e-35394136ead1-kube-api-access-5xw6t\") pod \"cert-manager-59c77684cc-x6jkd\" (UID: \"b2c2db1d-2c93-4c38-b04e-35394136ead1\") " pod="cert-manager/cert-manager-59c77684cc-x6jkd" Jun 14 22:55:19.080801 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:19.080701 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-x6jkd" Jun 14 22:55:19.203894 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:19.203863 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-x6jkd"] Jun 14 22:55:19.207368 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:55:19.207334 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2c2db1d_2c93_4c38_b04e_35394136ead1.slice/crio-6e2f870ba58e8179a3ed7c92fb8f3f8d2c8abcb27975a8f0da01a33804905b17 WatchSource:0}: Error finding container 6e2f870ba58e8179a3ed7c92fb8f3f8d2c8abcb27975a8f0da01a33804905b17: Status 404 returned error can't find the container with id 6e2f870ba58e8179a3ed7c92fb8f3f8d2c8abcb27975a8f0da01a33804905b17 Jun 14 22:55:20.020138 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:20.020099 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-x6jkd" event={"ID":"b2c2db1d-2c93-4c38-b04e-35394136ead1","Type":"ContainerStarted","Data":"a4aa5d7878307c68b4eb7f33eb2e31d0b56642c88390e164425e7c86084714bf"} Jun 14 22:55:20.020602 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:20.020154 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-x6jkd" event={"ID":"b2c2db1d-2c93-4c38-b04e-35394136ead1","Type":"ContainerStarted","Data":"6e2f870ba58e8179a3ed7c92fb8f3f8d2c8abcb27975a8f0da01a33804905b17"} Jun 14 22:55:20.039781 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:20.039721 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-x6jkd" podStartSLOduration=2.0397064560000002 podStartE2EDuration="2.039706456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:20.037759591 +0000 UTC m=+440.104142336" watchObservedRunningTime="2026-06-14 22:55:20.039706456 +0000 UTC m=+440.106089209" Jun 14 22:55:34.953415 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:34.953382 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c"] Jun 14 22:55:34.956034 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:34.956013 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:34.958339 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:34.958318 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v4tk7\"" Jun 14 22:55:34.958445 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:34.958359 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 22:55:34.959261 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:34.959245 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 22:55:34.964273 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:34.964068 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c"] Jun 14 22:55:35.039011 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.038973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.039181 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.039028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf7xf\" (UniqueName: \"kubernetes.io/projected/621659b2-305b-453c-afcc-b5cfec71c2a3-kube-api-access-bf7xf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.039181 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.039087 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.139983 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.139955 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.140143 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.139994 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf7xf\" (UniqueName: \"kubernetes.io/projected/621659b2-305b-453c-afcc-b5cfec71c2a3-kube-api-access-bf7xf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.140143 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.140029 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.140350 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.140332 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.140389 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.140349 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.147862 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.147833 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf7xf\" (UniqueName: \"kubernetes.io/projected/621659b2-305b-453c-afcc-b5cfec71c2a3-kube-api-access-bf7xf\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.267313 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.267238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:35.400771 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:35.400732 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c"] Jun 14 22:55:35.403436 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:55:35.403398 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621659b2_305b_453c_afcc_b5cfec71c2a3.slice/crio-e52ed81d0624e67a8b7736ca7cf306b821b044667b1acbdc83c25b31d1ffe3e6 WatchSource:0}: Error finding container e52ed81d0624e67a8b7736ca7cf306b821b044667b1acbdc83c25b31d1ffe3e6: Status 404 returned error can't find the container with id e52ed81d0624e67a8b7736ca7cf306b821b044667b1acbdc83c25b31d1ffe3e6 Jun 14 22:55:36.097165 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:36.097130 2568 generic.go:356] "Generic (PLEG): container finished" podID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerID="82836612b61453cf91dd99d694d9d2a43cf396d41a8646299459572d7dfe675e" exitCode=0 Jun 14 22:55:36.097651 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:36.097216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" event={"ID":"621659b2-305b-453c-afcc-b5cfec71c2a3","Type":"ContainerDied","Data":"82836612b61453cf91dd99d694d9d2a43cf396d41a8646299459572d7dfe675e"} Jun 14 22:55:36.097651 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:36.097265 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" event={"ID":"621659b2-305b-453c-afcc-b5cfec71c2a3","Type":"ContainerStarted","Data":"e52ed81d0624e67a8b7736ca7cf306b821b044667b1acbdc83c25b31d1ffe3e6"} Jun 14 22:55:37.103265 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:37.103236 2568 generic.go:356] "Generic (PLEG): container finished" podID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerID="c81d028a644a69bc626ef315d0e27923f834354f668978e326fb2d585bddb449" exitCode=0 Jun 14 22:55:37.103640 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:37.103304 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" event={"ID":"621659b2-305b-453c-afcc-b5cfec71c2a3","Type":"ContainerDied","Data":"c81d028a644a69bc626ef315d0e27923f834354f668978e326fb2d585bddb449"} Jun 14 22:55:38.109618 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:38.109581 2568 generic.go:356] "Generic (PLEG): container finished" podID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerID="9c26481f204f996158f38809cfe13b9deda9e8da7a66de2b32969b28ab413e10" exitCode=0 Jun 14 22:55:38.110018 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:38.109664 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" event={"ID":"621659b2-305b-453c-afcc-b5cfec71c2a3","Type":"ContainerDied","Data":"9c26481f204f996158f38809cfe13b9deda9e8da7a66de2b32969b28ab413e10"} Jun 14 22:55:39.239707 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.239678 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:39.275049 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.275023 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-bundle\") pod \"621659b2-305b-453c-afcc-b5cfec71c2a3\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " Jun 14 22:55:39.275183 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.275060 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-util\") pod \"621659b2-305b-453c-afcc-b5cfec71c2a3\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " Jun 14 22:55:39.275183 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.275129 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bf7xf\" (UniqueName: \"kubernetes.io/projected/621659b2-305b-453c-afcc-b5cfec71c2a3-kube-api-access-bf7xf\") pod \"621659b2-305b-453c-afcc-b5cfec71c2a3\" (UID: \"621659b2-305b-453c-afcc-b5cfec71c2a3\") " Jun 14 22:55:39.275813 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.275787 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-bundle" (OuterVolumeSpecName: "bundle") pod "621659b2-305b-453c-afcc-b5cfec71c2a3" (UID: "621659b2-305b-453c-afcc-b5cfec71c2a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:55:39.277169 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.277147 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/621659b2-305b-453c-afcc-b5cfec71c2a3-kube-api-access-bf7xf" (OuterVolumeSpecName: "kube-api-access-bf7xf") pod "621659b2-305b-453c-afcc-b5cfec71c2a3" (UID: "621659b2-305b-453c-afcc-b5cfec71c2a3"). InnerVolumeSpecName "kube-api-access-bf7xf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:55:39.280666 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.280641 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-util" (OuterVolumeSpecName: "util") pod "621659b2-305b-453c-afcc-b5cfec71c2a3" (UID: "621659b2-305b-453c-afcc-b5cfec71c2a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:55:39.376012 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.375949 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bf7xf\" (UniqueName: \"kubernetes.io/projected/621659b2-305b-453c-afcc-b5cfec71c2a3-kube-api-access-bf7xf\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:55:39.376012 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.375970 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:55:39.376012 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:39.375980 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621659b2-305b-453c-afcc-b5cfec71c2a3-util\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:55:40.120412 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:40.120382 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" Jun 14 22:55:40.120604 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:40.120415 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsf55c" event={"ID":"621659b2-305b-453c-afcc-b5cfec71c2a3","Type":"ContainerDied","Data":"e52ed81d0624e67a8b7736ca7cf306b821b044667b1acbdc83c25b31d1ffe3e6"} Jun 14 22:55:40.120604 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:40.120460 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e52ed81d0624e67a8b7736ca7cf306b821b044667b1acbdc83c25b31d1ffe3e6" Jun 14 22:55:47.690078 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.690043 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l"] Jun 14 22:55:47.690500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.690382 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerName="util" Jun 14 22:55:47.690500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.690396 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerName="util" Jun 14 22:55:47.690500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.690402 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerName="pull" Jun 14 22:55:47.690500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.690408 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerName="pull" Jun 14 22:55:47.690500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.690422 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerName="extract" Jun 14 22:55:47.690500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.690427 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerName="extract" Jun 14 22:55:47.690500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.690489 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="621659b2-305b-453c-afcc-b5cfec71c2a3" containerName="extract" Jun 14 22:55:47.694927 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.694909 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.698213 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.698189 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 14 22:55:47.698213 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.698204 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 14 22:55:47.698377 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.698200 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 14 22:55:47.698377 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.698226 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vhkcw\"" Jun 14 22:55:47.698377 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.698251 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 14 22:55:47.698377 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.698277 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 14 22:55:47.701733 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.701659 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l"] Jun 14 22:55:47.744268 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.744240 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36f5c55e-5f7c-48d0-b4df-949b883aa88c-cert\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.744396 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.744270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvhqx\" (UniqueName: \"kubernetes.io/projected/36f5c55e-5f7c-48d0-b4df-949b883aa88c-kube-api-access-mvhqx\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.744450 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.744387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36f5c55e-5f7c-48d0-b4df-949b883aa88c-metrics-cert\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.744450 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.744421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36f5c55e-5f7c-48d0-b4df-949b883aa88c-manager-config\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.845682 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.845653 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36f5c55e-5f7c-48d0-b4df-949b883aa88c-metrics-cert\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.845682 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.845683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36f5c55e-5f7c-48d0-b4df-949b883aa88c-manager-config\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.845914 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.845713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36f5c55e-5f7c-48d0-b4df-949b883aa88c-cert\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.845914 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.845816 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvhqx\" (UniqueName: \"kubernetes.io/projected/36f5c55e-5f7c-48d0-b4df-949b883aa88c-kube-api-access-mvhqx\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.846398 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.846379 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/36f5c55e-5f7c-48d0-b4df-949b883aa88c-manager-config\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.848120 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.848093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/36f5c55e-5f7c-48d0-b4df-949b883aa88c-metrics-cert\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.848281 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.848262 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/36f5c55e-5f7c-48d0-b4df-949b883aa88c-cert\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:47.857988 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:47.857968 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvhqx\" (UniqueName: \"kubernetes.io/projected/36f5c55e-5f7c-48d0-b4df-949b883aa88c-kube-api-access-mvhqx\") pod \"lws-controller-manager-59bb6ccd6d-lbt7l\" (UID: \"36f5c55e-5f7c-48d0-b4df-949b883aa88c\") " pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:48.004924 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:48.004826 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:48.162005 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:48.161946 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l"] Jun 14 22:55:48.164094 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:55:48.164072 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36f5c55e_5f7c_48d0_b4df_949b883aa88c.slice/crio-2872e895636381af078c3bc91032e3ccd58843b4fea91bd115cd487f34d4de93 WatchSource:0}: Error finding container 2872e895636381af078c3bc91032e3ccd58843b4fea91bd115cd487f34d4de93: Status 404 returned error can't find the container with id 2872e895636381af078c3bc91032e3ccd58843b4fea91bd115cd487f34d4de93 Jun 14 22:55:49.176823 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:49.176780 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" event={"ID":"36f5c55e-5f7c-48d0-b4df-949b883aa88c","Type":"ContainerStarted","Data":"2872e895636381af078c3bc91032e3ccd58843b4fea91bd115cd487f34d4de93"} Jun 14 22:55:51.187908 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.187874 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" event={"ID":"36f5c55e-5f7c-48d0-b4df-949b883aa88c","Type":"ContainerStarted","Data":"ba16b11868247191912fe3521f6c0e321a62abd80e20d0b326535114fe7f99e8"} Jun 14 22:55:51.188347 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.188104 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:55:51.204232 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.204190 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" podStartSLOduration=1.631530057 podStartE2EDuration="4.204175641s" totalImagesPullingTime="2.572645584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:51.202993769 +0000 UTC m=+471.269376523" watchObservedRunningTime="2026-06-14 22:55:51.204175641 +0000 UTC m=+471.270558395" Jun 14 22:55:51.593258 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.593177 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b"] Jun 14 22:55:51.597308 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.597286 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.599968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.599728 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rxwmc\"" Jun 14 22:55:51.599968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.599791 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 14 22:55:51.599968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.599836 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 14 22:55:51.599968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.599799 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 14 22:55:51.599968 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.599797 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 14 22:55:51.611345 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.611322 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b"] Jun 14 22:55:51.680937 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.680906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/382da98a-20e8-40fe-b00a-d60601f391bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.680937 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.680942 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/382da98a-20e8-40fe-b00a-d60601f391bc-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.681137 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.680968 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382da98a-20e8-40fe-b00a-d60601f391bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.681137 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.680998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gps8k\" (UniqueName: \"kubernetes.io/projected/382da98a-20e8-40fe-b00a-d60601f391bc-kube-api-access-gps8k\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.681137 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.681033 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/382da98a-20e8-40fe-b00a-d60601f391bc-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.781736 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.781697 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/382da98a-20e8-40fe-b00a-d60601f391bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.781929 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.781763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/382da98a-20e8-40fe-b00a-d60601f391bc-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.781929 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.781793 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382da98a-20e8-40fe-b00a-d60601f391bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.781929 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.781813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gps8k\" (UniqueName: \"kubernetes.io/projected/382da98a-20e8-40fe-b00a-d60601f391bc-kube-api-access-gps8k\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.781929 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.781844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/382da98a-20e8-40fe-b00a-d60601f391bc-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.782291 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.782261 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/382da98a-20e8-40fe-b00a-d60601f391bc-manifests\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.784084 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.784057 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/382da98a-20e8-40fe-b00a-d60601f391bc-tmp\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.784313 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.784288 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/382da98a-20e8-40fe-b00a-d60601f391bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.784313 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.784306 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/382da98a-20e8-40fe-b00a-d60601f391bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.789247 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.789225 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gps8k\" (UniqueName: \"kubernetes.io/projected/382da98a-20e8-40fe-b00a-d60601f391bc-kube-api-access-gps8k\") pod \"opendatahub-operator-controller-manager-7cf75689df-jqc8b\" (UID: \"382da98a-20e8-40fe-b00a-d60601f391bc\") " pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:51.908461 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:51.908390 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:52.047904 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:52.047879 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b"] Jun 14 22:55:52.049643 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:55:52.049620 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382da98a_20e8_40fe_b00a_d60601f391bc.slice/crio-6c1160d98a488188cc58a350d5c5c0eee7d54cb0ab458862f7e3132da34e3c83 WatchSource:0}: Error finding container 6c1160d98a488188cc58a350d5c5c0eee7d54cb0ab458862f7e3132da34e3c83: Status 404 returned error can't find the container with id 6c1160d98a488188cc58a350d5c5c0eee7d54cb0ab458862f7e3132da34e3c83 Jun 14 22:55:52.194065 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:52.194035 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" event={"ID":"382da98a-20e8-40fe-b00a-d60601f391bc","Type":"ContainerStarted","Data":"6c1160d98a488188cc58a350d5c5c0eee7d54cb0ab458862f7e3132da34e3c83"} Jun 14 22:55:55.212829 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:55.212793 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" event={"ID":"382da98a-20e8-40fe-b00a-d60601f391bc","Type":"ContainerStarted","Data":"9a28428deb9c41b78faa42b7e991d16df156c6e99a583fef933cfe41ce5d9c09"} Jun 14 22:55:56.219640 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:56.219610 2568 generic.go:356] "Generic (PLEG): container finished" podID="382da98a-20e8-40fe-b00a-d60601f391bc" containerID="9a28428deb9c41b78faa42b7e991d16df156c6e99a583fef933cfe41ce5d9c09" exitCode=0 Jun 14 22:55:56.220037 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:56.219692 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" event={"ID":"382da98a-20e8-40fe-b00a-d60601f391bc","Type":"ContainerDied","Data":"9a28428deb9c41b78faa42b7e991d16df156c6e99a583fef933cfe41ce5d9c09"} Jun 14 22:55:57.226521 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:57.226481 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" event={"ID":"382da98a-20e8-40fe-b00a-d60601f391bc","Type":"ContainerStarted","Data":"6342f2cd71c8331d1bb353c23aacfd24bcf8726811b5c5c13fe962f64e257e84"} Jun 14 22:55:57.226907 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:57.226556 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:55:57.247778 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:55:57.247709 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" podStartSLOduration=2.302771275 podStartE2EDuration="6.247694468s" totalImagesPullingTime="3.025909662s" totalInitContainerRuntime="919.013531ms" isStatefulPod=false podCreationTimestamp="2026-06-14 22:55:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:55:57.245413176 +0000 UTC m=+477.311795949" watchObservedRunningTime="2026-06-14 22:55:57.247694468 +0000 UTC m=+477.314077221" Jun 14 22:56:02.197114 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:02.197080 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59bb6ccd6d-lbt7l" Jun 14 22:56:08.234342 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:08.234314 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cf75689df-jqc8b" Jun 14 22:56:10.808357 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.808328 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f989997cb-252d8"] Jun 14 22:56:10.817739 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.817712 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:10.820183 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.820157 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 14 22:56:10.820320 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.820303 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 14 22:56:10.820400 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.820326 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 14 22:56:10.820624 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.820608 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-7bbpc\"" Jun 14 22:56:10.820722 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.820661 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 14 22:56:10.822613 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.822585 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f989997cb-252d8"] Jun 14 22:56:10.967108 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.967077 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-tls-certs\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:10.967108 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.967107 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-tmp\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:10.967349 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:10.967126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vsn8\" (UniqueName: \"kubernetes.io/projected/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-kube-api-access-8vsn8\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:11.068102 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.068012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-tls-certs\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:11.068102 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.068045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-tmp\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:11.068102 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.068065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vsn8\" (UniqueName: \"kubernetes.io/projected/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-kube-api-access-8vsn8\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:11.070349 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.070321 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-tmp\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:11.070489 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.070473 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-tls-certs\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:11.075635 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.075618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vsn8\" (UniqueName: \"kubernetes.io/projected/f8f43de9-2fbe-48fd-a109-c10f4fdc185d-kube-api-access-8vsn8\") pod \"kube-auth-proxy-7f989997cb-252d8\" (UID: \"f8f43de9-2fbe-48fd-a109-c10f4fdc185d\") " pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:11.129563 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.129530 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" Jun 14 22:56:11.268161 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.268133 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f989997cb-252d8"] Jun 14 22:56:11.270043 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:56:11.270013 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8f43de9_2fbe_48fd_a109_c10f4fdc185d.slice/crio-2c6d3b4c306718676842615b72f0866bc6357f4c9a08a455bfac96722971b69e WatchSource:0}: Error finding container 2c6d3b4c306718676842615b72f0866bc6357f4c9a08a455bfac96722971b69e: Status 404 returned error can't find the container with id 2c6d3b4c306718676842615b72f0866bc6357f4c9a08a455bfac96722971b69e Jun 14 22:56:11.293028 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:11.292999 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" event={"ID":"f8f43de9-2fbe-48fd-a109-c10f4fdc185d","Type":"ContainerStarted","Data":"2c6d3b4c306718676842615b72f0866bc6357f4c9a08a455bfac96722971b69e"} Jun 14 22:56:14.311424 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:14.311382 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" event={"ID":"f8f43de9-2fbe-48fd-a109-c10f4fdc185d","Type":"ContainerStarted","Data":"925af36a6d394792280d3aee7b724c441b68599f8e87285417b3017a05cec6fc"} Jun 14 22:56:14.326339 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:56:14.326281 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f989997cb-252d8" podStartSLOduration=1.481377188 podStartE2EDuration="4.326264067s" totalImagesPullingTime="2.844886879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:56:14.325851267 +0000 UTC m=+494.392234035" watchObservedRunningTime="2026-06-14 22:56:14.326264067 +0000 UTC m=+494.392646822" Jun 14 22:58:00.356393 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:00.356359 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 22:58:00.356888 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:00.356488 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 22:58:00.364377 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:00.364347 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:58:00.364377 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:00.364353 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 22:58:07.650028 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.649993 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9"] Jun 14 22:58:07.653540 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.653519 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.656193 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.656164 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 14 22:58:07.656327 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.656171 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 14 22:58:07.656327 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.656209 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cv5t5\"" Jun 14 22:58:07.656327 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.656175 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 14 22:58:07.656327 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.656175 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 14 22:58:07.661411 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.661390 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9"] Jun 14 22:58:07.780293 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.780257 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dqtk\" (UniqueName: \"kubernetes.io/projected/d2e91679-7412-4822-a369-3f09eefdacd8-kube-api-access-8dqtk\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.780497 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.780317 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2e91679-7412-4822-a369-3f09eefdacd8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.780497 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.780403 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2e91679-7412-4822-a369-3f09eefdacd8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.881006 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.880973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dqtk\" (UniqueName: \"kubernetes.io/projected/d2e91679-7412-4822-a369-3f09eefdacd8-kube-api-access-8dqtk\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.881171 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.881022 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2e91679-7412-4822-a369-3f09eefdacd8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.881171 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.881060 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2e91679-7412-4822-a369-3f09eefdacd8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.881730 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.881712 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2e91679-7412-4822-a369-3f09eefdacd8-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.883549 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.883524 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d2e91679-7412-4822-a369-3f09eefdacd8-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.888872 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.888853 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dqtk\" (UniqueName: \"kubernetes.io/projected/d2e91679-7412-4822-a369-3f09eefdacd8-kube-api-access-8dqtk\") pod \"kuadrant-console-plugin-66b5774985-lx6h9\" (UID: \"d2e91679-7412-4822-a369-3f09eefdacd8\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:07.964228 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:07.964198 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" Jun 14 22:58:08.099357 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:08.099331 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9"] Jun 14 22:58:08.101184 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:58:08.101159 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2e91679_7412_4822_a369_3f09eefdacd8.slice/crio-b639ce251064200c97070fec7ab5b61148d7d698c84fa3d47af9780594812c0d WatchSource:0}: Error finding container b639ce251064200c97070fec7ab5b61148d7d698c84fa3d47af9780594812c0d: Status 404 returned error can't find the container with id b639ce251064200c97070fec7ab5b61148d7d698c84fa3d47af9780594812c0d Jun 14 22:58:08.863675 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:08.863627 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" event={"ID":"d2e91679-7412-4822-a369-3f09eefdacd8","Type":"ContainerStarted","Data":"b639ce251064200c97070fec7ab5b61148d7d698c84fa3d47af9780594812c0d"} Jun 14 22:58:09.790144 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.788307 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86db6cd958-ks5lg"] Jun 14 22:58:09.793612 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.793592 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:09.805999 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.805978 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86db6cd958-ks5lg"] Jun 14 22:58:09.898354 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.898314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-config\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:09.898821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.898374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-oauth-config\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:09.898821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.898446 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-trusted-ca-bundle\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:09.898821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.898507 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8tdg\" (UniqueName: \"kubernetes.io/projected/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-kube-api-access-z8tdg\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:09.898821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.898563 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-service-ca\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:09.898821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.898611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-serving-cert\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:09.898821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.898631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-oauth-serving-cert\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.000476 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:09.999919 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8tdg\" (UniqueName: \"kubernetes.io/projected/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-kube-api-access-z8tdg\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.000476 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.000099 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-service-ca\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.000476 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.000145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-serving-cert\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.000792 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.000497 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-oauth-serving-cert\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.000792 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.000681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-config\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.000792 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.000733 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-oauth-config\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.000973 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.000773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-trusted-ca-bundle\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.001293 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.001165 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-service-ca\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.001293 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.001281 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-oauth-serving-cert\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.001481 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.001355 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-config\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.002152 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.002081 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-trusted-ca-bundle\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.004869 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.004830 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-serving-cert\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.005091 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.005069 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-console-oauth-config\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.008889 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.008631 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8tdg\" (UniqueName: \"kubernetes.io/projected/56af23e6-7cdb-45fa-8208-4bb4c6bebd07-kube-api-access-z8tdg\") pod \"console-86db6cd958-ks5lg\" (UID: \"56af23e6-7cdb-45fa-8208-4bb4c6bebd07\") " pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.108738 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.108654 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:10.276868 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.276832 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86db6cd958-ks5lg"] Jun 14 22:58:10.279624 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:58:10.279591 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56af23e6_7cdb_45fa_8208_4bb4c6bebd07.slice/crio-c6e98f595a524631d1c6d9325eb9277bbe09d562fa73f849d2ccbbf9ebd42e4e WatchSource:0}: Error finding container c6e98f595a524631d1c6d9325eb9277bbe09d562fa73f849d2ccbbf9ebd42e4e: Status 404 returned error can't find the container with id c6e98f595a524631d1c6d9325eb9277bbe09d562fa73f849d2ccbbf9ebd42e4e Jun 14 22:58:10.877216 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.877173 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86db6cd958-ks5lg" event={"ID":"56af23e6-7cdb-45fa-8208-4bb4c6bebd07","Type":"ContainerStarted","Data":"50e572879cbd45aba29498cf3e462842e778b468e2c850ed35366271a044c7a7"} Jun 14 22:58:10.877403 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.877234 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86db6cd958-ks5lg" event={"ID":"56af23e6-7cdb-45fa-8208-4bb4c6bebd07","Type":"ContainerStarted","Data":"c6e98f595a524631d1c6d9325eb9277bbe09d562fa73f849d2ccbbf9ebd42e4e"} Jun 14 22:58:10.895218 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:10.895163 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86db6cd958-ks5lg" podStartSLOduration=1.895148381 podStartE2EDuration="1.895148381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:10.893452771 +0000 UTC m=+610.959835524" watchObservedRunningTime="2026-06-14 22:58:10.895148381 +0000 UTC m=+610.961531134" Jun 14 22:58:20.109615 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:20.109506 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:20.110096 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:20.109626 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:20.114911 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:20.114880 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:20.947937 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:20.947637 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86db6cd958-ks5lg" Jun 14 22:58:20.998756 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:20.998708 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6d465c49-xn78t"] Jun 14 22:58:29.994345 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:29.994298 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" event={"ID":"d2e91679-7412-4822-a369-3f09eefdacd8","Type":"ContainerStarted","Data":"60047604de4481bbb6c42d1a6629cb6409adf523028a687f3f350c1dc09b8923"} Jun 14 22:58:30.010477 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:30.010427 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-lx6h9" podStartSLOduration=1.521981705 podStartE2EDuration="23.010403078s" totalImagesPullingTime="21.488421373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:30.008539664 +0000 UTC m=+630.074922420" watchObservedRunningTime="2026-06-14 22:58:30.010403078 +0000 UTC m=+630.076785832" Jun 14 22:58:46.024871 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.024835 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f6d465c49-xn78t" podUID="a343eb91-3408-4992-98be-a195f5ce7c62" containerName="console" containerID="cri-o://d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236" gracePeriod=15 Jun 14 22:58:46.281520 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.281453 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:58:46.334739 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.334709 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-service-ca\") pod \"a343eb91-3408-4992-98be-a195f5ce7c62\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " Jun 14 22:58:46.334906 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.334804 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-oauth-config\") pod \"a343eb91-3408-4992-98be-a195f5ce7c62\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " Jun 14 22:58:46.334906 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.334837 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-oauth-serving-cert\") pod \"a343eb91-3408-4992-98be-a195f5ce7c62\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " Jun 14 22:58:46.334906 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.334861 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-serving-cert\") pod \"a343eb91-3408-4992-98be-a195f5ce7c62\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " Jun 14 22:58:46.334906 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.334885 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk5js\" (UniqueName: \"kubernetes.io/projected/a343eb91-3408-4992-98be-a195f5ce7c62-kube-api-access-sk5js\") pod \"a343eb91-3408-4992-98be-a195f5ce7c62\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " Jun 14 22:58:46.335103 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.334932 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-trusted-ca-bundle\") pod \"a343eb91-3408-4992-98be-a195f5ce7c62\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " Jun 14 22:58:46.335103 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.334959 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-console-config\") pod \"a343eb91-3408-4992-98be-a195f5ce7c62\" (UID: \"a343eb91-3408-4992-98be-a195f5ce7c62\") " Jun 14 22:58:46.335103 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.335086 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-service-ca" (OuterVolumeSpecName: "service-ca") pod "a343eb91-3408-4992-98be-a195f5ce7c62" (UID: "a343eb91-3408-4992-98be-a195f5ce7c62"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:58:46.335652 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.335355 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-service-ca\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:58:46.335652 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.335350 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a343eb91-3408-4992-98be-a195f5ce7c62" (UID: "a343eb91-3408-4992-98be-a195f5ce7c62"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:58:46.335652 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.335414 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-console-config" (OuterVolumeSpecName: "console-config") pod "a343eb91-3408-4992-98be-a195f5ce7c62" (UID: "a343eb91-3408-4992-98be-a195f5ce7c62"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:58:46.335652 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.335596 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a343eb91-3408-4992-98be-a195f5ce7c62" (UID: "a343eb91-3408-4992-98be-a195f5ce7c62"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:58:46.337182 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.337110 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a343eb91-3408-4992-98be-a195f5ce7c62-kube-api-access-sk5js" (OuterVolumeSpecName: "kube-api-access-sk5js") pod "a343eb91-3408-4992-98be-a195f5ce7c62" (UID: "a343eb91-3408-4992-98be-a195f5ce7c62"). InnerVolumeSpecName "kube-api-access-sk5js". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:58:46.337182 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.337156 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a343eb91-3408-4992-98be-a195f5ce7c62" (UID: "a343eb91-3408-4992-98be-a195f5ce7c62"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:58:46.337360 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.337214 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a343eb91-3408-4992-98be-a195f5ce7c62" (UID: "a343eb91-3408-4992-98be-a195f5ce7c62"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 22:58:46.436655 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.436621 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-oauth-serving-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:58:46.436655 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.436654 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-serving-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:58:46.436884 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.436666 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk5js\" (UniqueName: \"kubernetes.io/projected/a343eb91-3408-4992-98be-a195f5ce7c62-kube-api-access-sk5js\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:58:46.436884 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.436681 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-trusted-ca-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:58:46.436884 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.436693 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a343eb91-3408-4992-98be-a195f5ce7c62-console-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:58:46.436884 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:46.436704 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a343eb91-3408-4992-98be-a195f5ce7c62-console-oauth-config\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:58:47.084929 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.084899 2568 generic.go:356] "Generic (PLEG): container finished" podID="a343eb91-3408-4992-98be-a195f5ce7c62" containerID="d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236" exitCode=0 Jun 14 22:58:47.085352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.084939 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6d465c49-xn78t" Jun 14 22:58:47.085352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.084990 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6d465c49-xn78t" event={"ID":"a343eb91-3408-4992-98be-a195f5ce7c62","Type":"ContainerDied","Data":"d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236"} Jun 14 22:58:47.085352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.085040 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6d465c49-xn78t" event={"ID":"a343eb91-3408-4992-98be-a195f5ce7c62","Type":"ContainerDied","Data":"4f5b875ac8f8a0cb454343ababa6ccdb945bf7ead435bd7e95f3fd24f04b6f2a"} Jun 14 22:58:47.085352 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.085061 2568 scope.go:117] "RemoveContainer" containerID="d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236" Jun 14 22:58:47.093910 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.093885 2568 scope.go:117] "RemoveContainer" containerID="d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236" Jun 14 22:58:47.094170 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:58:47.094153 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236\": container with ID starting with d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236 not found: ID does not exist" containerID="d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236" Jun 14 22:58:47.094222 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.094179 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236"} err="failed to get container status \"d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236\": rpc error: code = NotFound desc = could not find container \"d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236\": container with ID starting with d8bc8b17c3a688b390340f5243a01456e018aeeac997183af4b928a1915d1236 not found: ID does not exist" Jun 14 22:58:47.104671 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.104645 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f6d465c49-xn78t"] Jun 14 22:58:47.106426 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:47.106401 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f6d465c49-xn78t"] Jun 14 22:58:48.363559 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:48.363527 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a343eb91-3408-4992-98be-a195f5ce7c62" path="/var/lib/kubelet/pods/a343eb91-3408-4992-98be-a195f5ce7c62/volumes" Jun 14 22:58:49.446253 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.446215 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xm24z"] Jun 14 22:58:49.446638 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.446604 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a343eb91-3408-4992-98be-a195f5ce7c62" containerName="console" Jun 14 22:58:49.446638 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.446621 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a343eb91-3408-4992-98be-a195f5ce7c62" containerName="console" Jun 14 22:58:49.446710 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.446703 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a343eb91-3408-4992-98be-a195f5ce7c62" containerName="console" Jun 14 22:58:49.448876 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.448862 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:49.451060 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.451033 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 14 22:58:49.456243 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.456217 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xm24z"] Jun 14 22:58:49.463949 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.463920 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ww2\" (UniqueName: \"kubernetes.io/projected/9140a908-c100-47e5-9444-10ccada433f7-kube-api-access-98ww2\") pod \"limitador-limitador-64c94fd64f-xm24z\" (UID: \"9140a908-c100-47e5-9444-10ccada433f7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:49.464437 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.464407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9140a908-c100-47e5-9444-10ccada433f7-config-file\") pod \"limitador-limitador-64c94fd64f-xm24z\" (UID: \"9140a908-c100-47e5-9444-10ccada433f7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:49.539610 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.539574 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xm24z"] Jun 14 22:58:49.565245 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.565217 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ww2\" (UniqueName: \"kubernetes.io/projected/9140a908-c100-47e5-9444-10ccada433f7-kube-api-access-98ww2\") pod \"limitador-limitador-64c94fd64f-xm24z\" (UID: \"9140a908-c100-47e5-9444-10ccada433f7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:49.565441 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.565269 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9140a908-c100-47e5-9444-10ccada433f7-config-file\") pod \"limitador-limitador-64c94fd64f-xm24z\" (UID: \"9140a908-c100-47e5-9444-10ccada433f7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:49.565923 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.565903 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9140a908-c100-47e5-9444-10ccada433f7-config-file\") pod \"limitador-limitador-64c94fd64f-xm24z\" (UID: \"9140a908-c100-47e5-9444-10ccada433f7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:49.573042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.573018 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ww2\" (UniqueName: \"kubernetes.io/projected/9140a908-c100-47e5-9444-10ccada433f7-kube-api-access-98ww2\") pod \"limitador-limitador-64c94fd64f-xm24z\" (UID: \"9140a908-c100-47e5-9444-10ccada433f7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:49.760838 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.760734 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:49.892920 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.892895 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xm24z"] Jun 14 22:58:49.894771 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:58:49.894724 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9140a908_c100_47e5_9444_10ccada433f7.slice/crio-5fd583a888a94506dd758bbe9022f3cff7778085983485d994d847c313516b0f WatchSource:0}: Error finding container 5fd583a888a94506dd758bbe9022f3cff7778085983485d994d847c313516b0f: Status 404 returned error can't find the container with id 5fd583a888a94506dd758bbe9022f3cff7778085983485d994d847c313516b0f Jun 14 22:58:49.896654 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:49.896639 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 22:58:50.101519 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.101440 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" event={"ID":"9140a908-c100-47e5-9444-10ccada433f7","Type":"ContainerStarted","Data":"5fd583a888a94506dd758bbe9022f3cff7778085983485d994d847c313516b0f"} Jun 14 22:58:50.230886 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.230852 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-2dzvq"] Jun 14 22:58:50.236963 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.236940 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2dzvq" Jun 14 22:58:50.239500 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.239478 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cq8sx\"" Jun 14 22:58:50.242659 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.242639 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2dzvq"] Jun 14 22:58:50.271571 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.271545 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvwvk\" (UniqueName: \"kubernetes.io/projected/0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da-kube-api-access-gvwvk\") pod \"authorino-58cd955675-2dzvq\" (UID: \"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da\") " pod="kuadrant-system/authorino-58cd955675-2dzvq" Jun 14 22:58:50.372981 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.372912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvwvk\" (UniqueName: \"kubernetes.io/projected/0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da-kube-api-access-gvwvk\") pod \"authorino-58cd955675-2dzvq\" (UID: \"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da\") " pod="kuadrant-system/authorino-58cd955675-2dzvq" Jun 14 22:58:50.383159 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.383126 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvwvk\" (UniqueName: \"kubernetes.io/projected/0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da-kube-api-access-gvwvk\") pod \"authorino-58cd955675-2dzvq\" (UID: \"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da\") " pod="kuadrant-system/authorino-58cd955675-2dzvq" Jun 14 22:58:50.440136 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.440107 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzpv2"] Jun 14 22:58:50.445494 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.445472 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dzpv2" Jun 14 22:58:50.448847 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.448827 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzpv2"] Jun 14 22:58:50.474078 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.474047 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j54xx\" (UniqueName: \"kubernetes.io/projected/399f32b8-2f0c-4f4d-a941-66db62791694-kube-api-access-j54xx\") pod \"authorino-75d556bd77-dzpv2\" (UID: \"399f32b8-2f0c-4f4d-a941-66db62791694\") " pod="kuadrant-system/authorino-75d556bd77-dzpv2" Jun 14 22:58:50.547960 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.547885 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2dzvq" Jun 14 22:58:50.575416 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.575385 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j54xx\" (UniqueName: \"kubernetes.io/projected/399f32b8-2f0c-4f4d-a941-66db62791694-kube-api-access-j54xx\") pod \"authorino-75d556bd77-dzpv2\" (UID: \"399f32b8-2f0c-4f4d-a941-66db62791694\") " pod="kuadrant-system/authorino-75d556bd77-dzpv2" Jun 14 22:58:50.586177 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.586149 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j54xx\" (UniqueName: \"kubernetes.io/projected/399f32b8-2f0c-4f4d-a941-66db62791694-kube-api-access-j54xx\") pod \"authorino-75d556bd77-dzpv2\" (UID: \"399f32b8-2f0c-4f4d-a941-66db62791694\") " pod="kuadrant-system/authorino-75d556bd77-dzpv2" Jun 14 22:58:50.724535 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.724458 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-2dzvq"] Jun 14 22:58:50.727251 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:58:50.727219 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ee4e75b_42bd_4ce4_b36b_ad7c3bdf24da.slice/crio-c8d3acaf7db751cd9d16356343d20b4028599480ecc9ca683f7bad56ef8cc858 WatchSource:0}: Error finding container c8d3acaf7db751cd9d16356343d20b4028599480ecc9ca683f7bad56ef8cc858: Status 404 returned error can't find the container with id c8d3acaf7db751cd9d16356343d20b4028599480ecc9ca683f7bad56ef8cc858 Jun 14 22:58:50.755162 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.755132 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dzpv2" Jun 14 22:58:50.949233 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:50.949202 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzpv2"] Jun 14 22:58:50.951276 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:58:50.951247 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod399f32b8_2f0c_4f4d_a941_66db62791694.slice/crio-b7c005bb0a2d4b8be0f4e011a29611fc33bd9d9e53780f251fc2679a88b70a84 WatchSource:0}: Error finding container b7c005bb0a2d4b8be0f4e011a29611fc33bd9d9e53780f251fc2679a88b70a84: Status 404 returned error can't find the container with id b7c005bb0a2d4b8be0f4e011a29611fc33bd9d9e53780f251fc2679a88b70a84 Jun 14 22:58:51.108908 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:51.108867 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2dzvq" event={"ID":"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da","Type":"ContainerStarted","Data":"c8d3acaf7db751cd9d16356343d20b4028599480ecc9ca683f7bad56ef8cc858"} Jun 14 22:58:51.110345 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:51.110312 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dzpv2" event={"ID":"399f32b8-2f0c-4f4d-a941-66db62791694","Type":"ContainerStarted","Data":"b7c005bb0a2d4b8be0f4e011a29611fc33bd9d9e53780f251fc2679a88b70a84"} Jun 14 22:58:56.143197 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:56.143158 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2dzvq" event={"ID":"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da","Type":"ContainerStarted","Data":"b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2"} Jun 14 22:58:56.144794 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:56.144768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dzpv2" event={"ID":"399f32b8-2f0c-4f4d-a941-66db62791694","Type":"ContainerStarted","Data":"9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71"} Jun 14 22:58:56.146204 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:56.146173 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" event={"ID":"9140a908-c100-47e5-9444-10ccada433f7","Type":"ContainerStarted","Data":"e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6"} Jun 14 22:58:56.146326 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:56.146309 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:58:56.158577 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:56.158533 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-2dzvq" podStartSLOduration=1.3790358710000001 podStartE2EDuration="6.1585165s" totalImagesPullingTime="4.779480629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:56.157657766 +0000 UTC m=+656.224040521" watchObservedRunningTime="2026-06-14 22:58:56.1585165 +0000 UTC m=+656.224899253" Jun 14 22:58:56.173510 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:56.173460 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" podStartSLOduration=1.561409281 podStartE2EDuration="7.173447082s" totalImagesPullingTime="5.612037801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:56.173175683 +0000 UTC m=+656.239558437" watchObservedRunningTime="2026-06-14 22:58:56.173447082 +0000 UTC m=+656.239829851" Jun 14 22:58:56.186269 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:56.186182 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-dzpv2" podStartSLOduration=1.6263457730000002 podStartE2EDuration="6.186162529s" totalImagesPullingTime="4.559816756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:58:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:58:56.185376511 +0000 UTC m=+656.251759286" watchObservedRunningTime="2026-06-14 22:58:56.186162529 +0000 UTC m=+656.252545285" Jun 14 22:58:56.214281 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:56.214248 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2dzvq"] Jun 14 22:58:58.156339 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:58.156298 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-2dzvq" podUID="0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da" containerName="authorino" containerID="cri-o://b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2" gracePeriod=30 Jun 14 22:58:58.979901 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:58.979870 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2dzvq" Jun 14 22:58:59.056180 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.056108 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvwvk\" (UniqueName: \"kubernetes.io/projected/0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da-kube-api-access-gvwvk\") pod \"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da\" (UID: \"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da\") " Jun 14 22:58:59.058274 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.058252 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da-kube-api-access-gvwvk" (OuterVolumeSpecName: "kube-api-access-gvwvk") pod "0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da" (UID: "0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da"). InnerVolumeSpecName "kube-api-access-gvwvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:58:59.157076 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.157042 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvwvk\" (UniqueName: \"kubernetes.io/projected/0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da-kube-api-access-gvwvk\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:58:59.162528 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.162495 2568 generic.go:356] "Generic (PLEG): container finished" podID="0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da" containerID="b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2" exitCode=0 Jun 14 22:58:59.162676 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.162553 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-2dzvq" Jun 14 22:58:59.162676 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.162593 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2dzvq" event={"ID":"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da","Type":"ContainerDied","Data":"b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2"} Jun 14 22:58:59.162676 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.162638 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-2dzvq" event={"ID":"0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da","Type":"ContainerDied","Data":"c8d3acaf7db751cd9d16356343d20b4028599480ecc9ca683f7bad56ef8cc858"} Jun 14 22:58:59.162676 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.162655 2568 scope.go:117] "RemoveContainer" containerID="b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2" Jun 14 22:58:59.177878 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.177860 2568 scope.go:117] "RemoveContainer" containerID="b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2" Jun 14 22:58:59.178160 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:58:59.178140 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2\": container with ID starting with b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2 not found: ID does not exist" containerID="b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2" Jun 14 22:58:59.178218 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.178168 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2"} err="failed to get container status \"b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2\": rpc error: code = NotFound desc = could not find container \"b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2\": container with ID starting with b9167e5e03cc0009885ece53cb357b2883f8ad90a088d97b8a425d7d4e551ae2 not found: ID does not exist" Jun 14 22:58:59.187464 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.187439 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-2dzvq"] Jun 14 22:58:59.192674 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:58:59.192652 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-2dzvq"] Jun 14 22:59:00.364371 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:00.364342 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da" path="/var/lib/kubelet/pods/0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da/volumes" Jun 14 22:59:04.022061 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.022025 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xm24z"] Jun 14 22:59:04.022569 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.022255 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" podUID="9140a908-c100-47e5-9444-10ccada433f7" containerName="limitador" containerID="cri-o://e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6" gracePeriod=30 Jun 14 22:59:04.024677 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.024656 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:59:04.578403 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.578383 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:59:04.705363 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.705334 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98ww2\" (UniqueName: \"kubernetes.io/projected/9140a908-c100-47e5-9444-10ccada433f7-kube-api-access-98ww2\") pod \"9140a908-c100-47e5-9444-10ccada433f7\" (UID: \"9140a908-c100-47e5-9444-10ccada433f7\") " Jun 14 22:59:04.705518 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.705395 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9140a908-c100-47e5-9444-10ccada433f7-config-file\") pod \"9140a908-c100-47e5-9444-10ccada433f7\" (UID: \"9140a908-c100-47e5-9444-10ccada433f7\") " Jun 14 22:59:04.705699 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.705677 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9140a908-c100-47e5-9444-10ccada433f7-config-file" (OuterVolumeSpecName: "config-file") pod "9140a908-c100-47e5-9444-10ccada433f7" (UID: "9140a908-c100-47e5-9444-10ccada433f7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 22:59:04.707433 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.707407 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9140a908-c100-47e5-9444-10ccada433f7-kube-api-access-98ww2" (OuterVolumeSpecName: "kube-api-access-98ww2") pod "9140a908-c100-47e5-9444-10ccada433f7" (UID: "9140a908-c100-47e5-9444-10ccada433f7"). InnerVolumeSpecName "kube-api-access-98ww2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:59:04.806460 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.806423 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ww2\" (UniqueName: \"kubernetes.io/projected/9140a908-c100-47e5-9444-10ccada433f7-kube-api-access-98ww2\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:59:04.806460 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:04.806456 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9140a908-c100-47e5-9444-10ccada433f7-config-file\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:59:05.193144 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.193110 2568 generic.go:356] "Generic (PLEG): container finished" podID="9140a908-c100-47e5-9444-10ccada433f7" containerID="e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6" exitCode=0 Jun 14 22:59:05.193544 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.193153 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" Jun 14 22:59:05.193544 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.193193 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" event={"ID":"9140a908-c100-47e5-9444-10ccada433f7","Type":"ContainerDied","Data":"e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6"} Jun 14 22:59:05.193544 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.193244 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-xm24z" event={"ID":"9140a908-c100-47e5-9444-10ccada433f7","Type":"ContainerDied","Data":"5fd583a888a94506dd758bbe9022f3cff7778085983485d994d847c313516b0f"} Jun 14 22:59:05.193544 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.193270 2568 scope.go:117] "RemoveContainer" containerID="e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6" Jun 14 22:59:05.201986 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.201963 2568 scope.go:117] "RemoveContainer" containerID="e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6" Jun 14 22:59:05.202228 ip-10-0-129-69 kubenswrapper[2568]: E0614 22:59:05.202210 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6\": container with ID starting with e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6 not found: ID does not exist" containerID="e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6" Jun 14 22:59:05.202286 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.202238 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6"} err="failed to get container status \"e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6\": rpc error: code = NotFound desc = could not find container \"e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6\": container with ID starting with e2cea6734dadf9ff0ea95a901b95fea70e1432a833e731a0fbdb36a10f371ea6 not found: ID does not exist" Jun 14 22:59:05.213826 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.213805 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xm24z"] Jun 14 22:59:05.219562 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.219543 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-xm24z"] Jun 14 22:59:05.790523 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.790492 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-wgcvf"] Jun 14 22:59:05.790986 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.790961 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da" containerName="authorino" Jun 14 22:59:05.791130 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.791064 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da" containerName="authorino" Jun 14 22:59:05.791130 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.791085 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9140a908-c100-47e5-9444-10ccada433f7" containerName="limitador" Jun 14 22:59:05.791130 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.791094 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9140a908-c100-47e5-9444-10ccada433f7" containerName="limitador" Jun 14 22:59:05.791291 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.791257 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9140a908-c100-47e5-9444-10ccada433f7" containerName="limitador" Jun 14 22:59:05.791291 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.791272 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ee4e75b-42bd-4ce4-b36b-ad7c3bdf24da" containerName="authorino" Jun 14 22:59:05.796040 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.796020 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:05.798313 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.798294 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7xlvg\"" Jun 14 22:59:05.798447 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.798298 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 14 22:59:05.801800 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.801768 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wgcvf"] Jun 14 22:59:05.915028 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.915000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxh2p\" (UniqueName: \"kubernetes.io/projected/d361bdf6-2a0d-41ab-ac42-cf172dc9616c-kube-api-access-zxh2p\") pod \"postgres-69fb4594cf-wgcvf\" (UID: \"d361bdf6-2a0d-41ab-ac42-cf172dc9616c\") " pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:05.915210 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:05.915075 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d361bdf6-2a0d-41ab-ac42-cf172dc9616c-data\") pod \"postgres-69fb4594cf-wgcvf\" (UID: \"d361bdf6-2a0d-41ab-ac42-cf172dc9616c\") " pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:06.015725 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:06.015695 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxh2p\" (UniqueName: \"kubernetes.io/projected/d361bdf6-2a0d-41ab-ac42-cf172dc9616c-kube-api-access-zxh2p\") pod \"postgres-69fb4594cf-wgcvf\" (UID: \"d361bdf6-2a0d-41ab-ac42-cf172dc9616c\") " pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:06.015907 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:06.015777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d361bdf6-2a0d-41ab-ac42-cf172dc9616c-data\") pod \"postgres-69fb4594cf-wgcvf\" (UID: \"d361bdf6-2a0d-41ab-ac42-cf172dc9616c\") " pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:06.016138 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:06.016121 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d361bdf6-2a0d-41ab-ac42-cf172dc9616c-data\") pod \"postgres-69fb4594cf-wgcvf\" (UID: \"d361bdf6-2a0d-41ab-ac42-cf172dc9616c\") " pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:06.023107 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:06.023087 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxh2p\" (UniqueName: \"kubernetes.io/projected/d361bdf6-2a0d-41ab-ac42-cf172dc9616c-kube-api-access-zxh2p\") pod \"postgres-69fb4594cf-wgcvf\" (UID: \"d361bdf6-2a0d-41ab-ac42-cf172dc9616c\") " pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:06.107229 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:06.107138 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:06.237722 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:06.237698 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-wgcvf"] Jun 14 22:59:06.239728 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:59:06.239702 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd361bdf6_2a0d_41ab_ac42_cf172dc9616c.slice/crio-06da5355942431686365ad9b92433f992e827fe26ce8ed6f71d431e38b209135 WatchSource:0}: Error finding container 06da5355942431686365ad9b92433f992e827fe26ce8ed6f71d431e38b209135: Status 404 returned error can't find the container with id 06da5355942431686365ad9b92433f992e827fe26ce8ed6f71d431e38b209135 Jun 14 22:59:06.364581 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:06.364502 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9140a908-c100-47e5-9444-10ccada433f7" path="/var/lib/kubelet/pods/9140a908-c100-47e5-9444-10ccada433f7/volumes" Jun 14 22:59:07.208905 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:07.208845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wgcvf" event={"ID":"d361bdf6-2a0d-41ab-ac42-cf172dc9616c","Type":"ContainerStarted","Data":"06da5355942431686365ad9b92433f992e827fe26ce8ed6f71d431e38b209135"} Jun 14 22:59:09.220875 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:09.220838 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-wgcvf" event={"ID":"d361bdf6-2a0d-41ab-ac42-cf172dc9616c","Type":"ContainerStarted","Data":"0085a4acbef18a473bd8233bac6100c2043c8038cc03ffaf363f217fa734400c"} Jun 14 22:59:09.221244 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:09.220940 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:09.237519 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:09.237471 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-wgcvf" podStartSLOduration=1.767772938 podStartE2EDuration="4.237456979s" totalImagesPullingTime="2.469684041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:59:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:59:09.23538171 +0000 UTC m=+669.301764488" watchObservedRunningTime="2026-06-14 22:59:09.237456979 +0000 UTC m=+669.303839733" Jun 14 22:59:15.259829 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:15.259802 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-wgcvf" Jun 14 22:59:16.748046 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.748006 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw"] Jun 14 22:59:16.752120 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.752097 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.754683 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.754660 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 14 22:59:16.754815 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.754664 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 14 22:59:16.755469 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.755454 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-v4tk7\"" Jun 14 22:59:16.763578 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.763553 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw"] Jun 14 22:59:16.817117 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.817084 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5cb4\" (UniqueName: \"kubernetes.io/projected/32b2b8c8-70d6-4ad4-8bae-04440052816a-kube-api-access-m5cb4\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.817273 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.817142 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.817273 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.817205 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.917855 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.917821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.918017 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.917874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5cb4\" (UniqueName: \"kubernetes.io/projected/32b2b8c8-70d6-4ad4-8bae-04440052816a-kube-api-access-m5cb4\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.918017 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.917921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.918272 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.918256 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.918331 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.918313 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:16.932282 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:16.932250 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5cb4\" (UniqueName: \"kubernetes.io/projected/32b2b8c8-70d6-4ad4-8bae-04440052816a-kube-api-access-m5cb4\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:17.062735 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:17.062667 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:17.192492 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:17.192470 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw"] Jun 14 22:59:17.194867 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:59:17.194841 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b2b8c8_70d6_4ad4_8bae_04440052816a.slice/crio-5bb7589a540b493e716951a74b2769daf1497789c0d2d3de6de4287c4739a064 WatchSource:0}: Error finding container 5bb7589a540b493e716951a74b2769daf1497789c0d2d3de6de4287c4739a064: Status 404 returned error can't find the container with id 5bb7589a540b493e716951a74b2769daf1497789c0d2d3de6de4287c4739a064 Jun 14 22:59:17.262361 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:17.262332 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" event={"ID":"32b2b8c8-70d6-4ad4-8bae-04440052816a","Type":"ContainerStarted","Data":"f9557236a7fd5592f64df9585c4ab05b8cc1183e60d2161e13f98634c9b2f3c7"} Jun 14 22:59:17.262481 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:17.262383 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" event={"ID":"32b2b8c8-70d6-4ad4-8bae-04440052816a","Type":"ContainerStarted","Data":"5bb7589a540b493e716951a74b2769daf1497789c0d2d3de6de4287c4739a064"} Jun 14 22:59:18.268931 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:18.268846 2568 generic.go:356] "Generic (PLEG): container finished" podID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerID="f9557236a7fd5592f64df9585c4ab05b8cc1183e60d2161e13f98634c9b2f3c7" exitCode=0 Jun 14 22:59:18.269273 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:18.268926 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" event={"ID":"32b2b8c8-70d6-4ad4-8bae-04440052816a","Type":"ContainerDied","Data":"f9557236a7fd5592f64df9585c4ab05b8cc1183e60d2161e13f98634c9b2f3c7"} Jun 14 22:59:19.277874 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:19.277839 2568 generic.go:356] "Generic (PLEG): container finished" podID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerID="1975532d756e4ea62ed9b9d53c1975afe48926b948e66a7b092f007b9c4c42fd" exitCode=0 Jun 14 22:59:19.278277 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:19.277948 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" event={"ID":"32b2b8c8-70d6-4ad4-8bae-04440052816a","Type":"ContainerDied","Data":"1975532d756e4ea62ed9b9d53c1975afe48926b948e66a7b092f007b9c4c42fd"} Jun 14 22:59:20.285360 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:20.285328 2568 generic.go:356] "Generic (PLEG): container finished" podID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerID="2806798eaf0989e7c1b1b600073bfd562d9c7ea8b1a1e5e3449c099610cb5924" exitCode=0 Jun 14 22:59:20.285780 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:20.285398 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" event={"ID":"32b2b8c8-70d6-4ad4-8bae-04440052816a","Type":"ContainerDied","Data":"2806798eaf0989e7c1b1b600073bfd562d9c7ea8b1a1e5e3449c099610cb5924"} Jun 14 22:59:21.445022 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.444994 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:21.560296 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.560223 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5cb4\" (UniqueName: \"kubernetes.io/projected/32b2b8c8-70d6-4ad4-8bae-04440052816a-kube-api-access-m5cb4\") pod \"32b2b8c8-70d6-4ad4-8bae-04440052816a\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " Jun 14 22:59:21.560296 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.560262 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-bundle\") pod \"32b2b8c8-70d6-4ad4-8bae-04440052816a\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " Jun 14 22:59:21.560491 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.560323 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-util\") pod \"32b2b8c8-70d6-4ad4-8bae-04440052816a\" (UID: \"32b2b8c8-70d6-4ad4-8bae-04440052816a\") " Jun 14 22:59:21.560860 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.560836 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-bundle" (OuterVolumeSpecName: "bundle") pod "32b2b8c8-70d6-4ad4-8bae-04440052816a" (UID: "32b2b8c8-70d6-4ad4-8bae-04440052816a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:59:21.562348 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.562317 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b2b8c8-70d6-4ad4-8bae-04440052816a-kube-api-access-m5cb4" (OuterVolumeSpecName: "kube-api-access-m5cb4") pod "32b2b8c8-70d6-4ad4-8bae-04440052816a" (UID: "32b2b8c8-70d6-4ad4-8bae-04440052816a"). InnerVolumeSpecName "kube-api-access-m5cb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 22:59:21.566042 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.566009 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-util" (OuterVolumeSpecName: "util") pod "32b2b8c8-70d6-4ad4-8bae-04440052816a" (UID: "32b2b8c8-70d6-4ad4-8bae-04440052816a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 14 22:59:21.661758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.661708 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5cb4\" (UniqueName: \"kubernetes.io/projected/32b2b8c8-70d6-4ad4-8bae-04440052816a-kube-api-access-m5cb4\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:59:21.661758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.661734 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-bundle\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:59:21.661758 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:21.661762 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32b2b8c8-70d6-4ad4-8bae-04440052816a-util\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 22:59:22.296523 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:22.296494 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" Jun 14 22:59:22.296523 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:22.296514 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748nnpxw" event={"ID":"32b2b8c8-70d6-4ad4-8bae-04440052816a","Type":"ContainerDied","Data":"5bb7589a540b493e716951a74b2769daf1497789c0d2d3de6de4287c4739a064"} Jun 14 22:59:22.296725 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:22.296558 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5bb7589a540b493e716951a74b2769daf1497789c0d2d3de6de4287c4739a064" Jun 14 22:59:44.567626 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.567591 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 22:59:44.568031 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.568000 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerName="extract" Jun 14 22:59:44.568031 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.568012 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerName="extract" Jun 14 22:59:44.568031 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.568027 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerName="pull" Jun 14 22:59:44.568134 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.568033 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerName="pull" Jun 14 22:59:44.568134 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.568043 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerName="util" Jun 14 22:59:44.568134 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.568048 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerName="util" Jun 14 22:59:44.568134 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.568109 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b2b8c8-70d6-4ad4-8bae-04440052816a" containerName="extract" Jun 14 22:59:44.584009 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.583981 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 22:59:44.584165 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.584072 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 22:59:44.586666 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.586639 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 22:59:44.586821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.586676 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 22:59:44.586821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.586704 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 22:59:44.586821 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.586773 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-frfxp\"" Jun 14 22:59:44.671618 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.671580 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twbrx\" (UniqueName: \"kubernetes.io/projected/909328ce-d109-4018-8f34-a18e93149f6e-kube-api-access-twbrx\") pod \"maas-keycloak-0\" (UID: \"909328ce-d109-4018-8f34-a18e93149f6e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 22:59:44.772564 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.772532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twbrx\" (UniqueName: \"kubernetes.io/projected/909328ce-d109-4018-8f34-a18e93149f6e-kube-api-access-twbrx\") pod \"maas-keycloak-0\" (UID: \"909328ce-d109-4018-8f34-a18e93149f6e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 22:59:44.780409 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.780383 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twbrx\" (UniqueName: \"kubernetes.io/projected/909328ce-d109-4018-8f34-a18e93149f6e-kube-api-access-twbrx\") pod \"maas-keycloak-0\" (UID: \"909328ce-d109-4018-8f34-a18e93149f6e\") " pod="keycloak-system/maas-keycloak-0" Jun 14 22:59:44.894119 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:44.894024 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 22:59:45.029716 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:45.029689 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 22:59:45.032091 ip-10-0-129-69 kubenswrapper[2568]: W0614 22:59:45.032065 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909328ce_d109_4018_8f34_a18e93149f6e.slice/crio-8a0d4d6e46ea264dad742752b2d53451a2495426959c760ed13443473bd8c10c WatchSource:0}: Error finding container 8a0d4d6e46ea264dad742752b2d53451a2495426959c760ed13443473bd8c10c: Status 404 returned error can't find the container with id 8a0d4d6e46ea264dad742752b2d53451a2495426959c760ed13443473bd8c10c Jun 14 22:59:45.409923 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:45.409887 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"909328ce-d109-4018-8f34-a18e93149f6e","Type":"ContainerStarted","Data":"8a0d4d6e46ea264dad742752b2d53451a2495426959c760ed13443473bd8c10c"} Jun 14 22:59:50.444669 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:50.444621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"909328ce-d109-4018-8f34-a18e93149f6e","Type":"ContainerStarted","Data":"edb7e7c7a05cf23afba1262187de98712b6c38291f75606e0328808f3ebf6f74"} Jun 14 22:59:50.463553 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:50.463487 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.831118902 podStartE2EDuration="6.463465799s" totalImagesPullingTime="4.632346897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 22:59:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 22:59:50.461260181 +0000 UTC m=+710.527642935" watchObservedRunningTime="2026-06-14 22:59:50.463465799 +0000 UTC m=+710.529848555" Jun 14 22:59:50.894685 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:50.894577 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 22:59:50.896424 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:50.896389 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:51.894984 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:51.894934 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:52.895237 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:52.895177 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:53.895442 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:53.895383 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:54.895088 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:54.895049 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 22:59:54.895397 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:54.895345 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:55.895613 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:55.895560 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:56.895278 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:56.895218 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:57.894602 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:57.894554 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:58.894818 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:58.894776 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 22:59:59.895284 ip-10-0-129-69 kubenswrapper[2568]: I0614 22:59:59.895223 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 23:00:00.894587 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:00.894545 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 23:00:01.895270 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:01.895225 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 14 23:00:03.005276 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:03.005237 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 23:00:03.021055 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:03.020997 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 23:00:13.011911 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:13.011822 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 23:00:13.862440 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:13.862395 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nvmw"] Jun 14 23:00:13.867830 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:13.867806 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2nvmw" Jun 14 23:00:13.872500 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:13.872471 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nvmw"] Jun 14 23:00:13.987570 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:13.987530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwndd\" (UniqueName: \"kubernetes.io/projected/7cbc7caf-07b5-497f-85d8-1c5d220460b1-kube-api-access-gwndd\") pod \"authorino-5d4b67c446-2nvmw\" (UID: \"7cbc7caf-07b5-497f-85d8-1c5d220460b1\") " pod="kuadrant-system/authorino-5d4b67c446-2nvmw" Jun 14 23:00:14.089131 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.089086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwndd\" (UniqueName: \"kubernetes.io/projected/7cbc7caf-07b5-497f-85d8-1c5d220460b1-kube-api-access-gwndd\") pod \"authorino-5d4b67c446-2nvmw\" (UID: \"7cbc7caf-07b5-497f-85d8-1c5d220460b1\") " pod="kuadrant-system/authorino-5d4b67c446-2nvmw" Jun 14 23:00:14.091178 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.091151 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nvmw"] Jun 14 23:00:14.091414 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:00:14.091396 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gwndd], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-2nvmw" podUID="7cbc7caf-07b5-497f-85d8-1c5d220460b1" Jun 14 23:00:14.104985 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.104951 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwndd\" (UniqueName: \"kubernetes.io/projected/7cbc7caf-07b5-497f-85d8-1c5d220460b1-kube-api-access-gwndd\") pod \"authorino-5d4b67c446-2nvmw\" (UID: \"7cbc7caf-07b5-497f-85d8-1c5d220460b1\") " pod="kuadrant-system/authorino-5d4b67c446-2nvmw" Jun 14 23:00:14.118540 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.118480 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-669579b5f8-rftgf"] Jun 14 23:00:14.122156 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.122136 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-669579b5f8-rftgf" Jun 14 23:00:14.128179 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.128157 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-669579b5f8-rftgf"] Jun 14 23:00:14.190414 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.190367 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkdfm\" (UniqueName: \"kubernetes.io/projected/1c091cf4-bffc-43ba-804d-26a452f5e86a-kube-api-access-gkdfm\") pod \"authorino-669579b5f8-rftgf\" (UID: \"1c091cf4-bffc-43ba-804d-26a452f5e86a\") " pod="kuadrant-system/authorino-669579b5f8-rftgf" Jun 14 23:00:14.245293 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.245259 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-669579b5f8-rftgf"] Jun 14 23:00:14.245611 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:00:14.245588 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gkdfm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-669579b5f8-rftgf" podUID="1c091cf4-bffc-43ba-804d-26a452f5e86a" Jun 14 23:00:14.276260 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.276227 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-788cd678cd-6t8zt"] Jun 14 23:00:14.279919 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.279900 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:00:14.282121 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.282102 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 14 23:00:14.286387 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.286359 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-788cd678cd-6t8zt"] Jun 14 23:00:14.291905 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.291882 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkdfm\" (UniqueName: \"kubernetes.io/projected/1c091cf4-bffc-43ba-804d-26a452f5e86a-kube-api-access-gkdfm\") pod \"authorino-669579b5f8-rftgf\" (UID: \"1c091cf4-bffc-43ba-804d-26a452f5e86a\") " pod="kuadrant-system/authorino-669579b5f8-rftgf" Jun 14 23:00:14.300455 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.300434 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkdfm\" (UniqueName: \"kubernetes.io/projected/1c091cf4-bffc-43ba-804d-26a452f5e86a-kube-api-access-gkdfm\") pod \"authorino-669579b5f8-rftgf\" (UID: \"1c091cf4-bffc-43ba-804d-26a452f5e86a\") " pod="kuadrant-system/authorino-669579b5f8-rftgf" Jun 14 23:00:14.393019 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.392930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7q8s\" (UniqueName: \"kubernetes.io/projected/886b86f7-6aec-4c0a-89da-94c0f71e95de-kube-api-access-q7q8s\") pod \"authorino-788cd678cd-6t8zt\" (UID: \"886b86f7-6aec-4c0a-89da-94c0f71e95de\") " pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:00:14.393019 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.392997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/886b86f7-6aec-4c0a-89da-94c0f71e95de-tls-cert\") pod \"authorino-788cd678cd-6t8zt\" (UID: \"886b86f7-6aec-4c0a-89da-94c0f71e95de\") " pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:00:14.494496 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.494458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7q8s\" (UniqueName: \"kubernetes.io/projected/886b86f7-6aec-4c0a-89da-94c0f71e95de-kube-api-access-q7q8s\") pod \"authorino-788cd678cd-6t8zt\" (UID: \"886b86f7-6aec-4c0a-89da-94c0f71e95de\") " pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:00:14.494667 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.494553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/886b86f7-6aec-4c0a-89da-94c0f71e95de-tls-cert\") pod \"authorino-788cd678cd-6t8zt\" (UID: \"886b86f7-6aec-4c0a-89da-94c0f71e95de\") " pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:00:14.497036 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.497010 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/886b86f7-6aec-4c0a-89da-94c0f71e95de-tls-cert\") pod \"authorino-788cd678cd-6t8zt\" (UID: \"886b86f7-6aec-4c0a-89da-94c0f71e95de\") " pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:00:14.503006 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.502978 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7q8s\" (UniqueName: \"kubernetes.io/projected/886b86f7-6aec-4c0a-89da-94c0f71e95de-kube-api-access-q7q8s\") pod \"authorino-788cd678cd-6t8zt\" (UID: \"886b86f7-6aec-4c0a-89da-94c0f71e95de\") " pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:00:14.590491 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.590453 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:00:14.610624 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.610595 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2nvmw" Jun 14 23:00:14.610737 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.610603 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-669579b5f8-rftgf" Jun 14 23:00:14.619307 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.619272 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2nvmw" Jun 14 23:00:14.627189 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.627151 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-669579b5f8-rftgf" Jun 14 23:00:14.696356 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.696321 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkdfm\" (UniqueName: \"kubernetes.io/projected/1c091cf4-bffc-43ba-804d-26a452f5e86a-kube-api-access-gkdfm\") pod \"1c091cf4-bffc-43ba-804d-26a452f5e86a\" (UID: \"1c091cf4-bffc-43ba-804d-26a452f5e86a\") " Jun 14 23:00:14.696497 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.696387 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwndd\" (UniqueName: \"kubernetes.io/projected/7cbc7caf-07b5-497f-85d8-1c5d220460b1-kube-api-access-gwndd\") pod \"7cbc7caf-07b5-497f-85d8-1c5d220460b1\" (UID: \"7cbc7caf-07b5-497f-85d8-1c5d220460b1\") " Jun 14 23:00:14.699862 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.699821 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cbc7caf-07b5-497f-85d8-1c5d220460b1-kube-api-access-gwndd" (OuterVolumeSpecName: "kube-api-access-gwndd") pod "7cbc7caf-07b5-497f-85d8-1c5d220460b1" (UID: "7cbc7caf-07b5-497f-85d8-1c5d220460b1"). InnerVolumeSpecName "kube-api-access-gwndd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:00:14.700027 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.699875 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c091cf4-bffc-43ba-804d-26a452f5e86a-kube-api-access-gkdfm" (OuterVolumeSpecName: "kube-api-access-gkdfm") pod "1c091cf4-bffc-43ba-804d-26a452f5e86a" (UID: "1c091cf4-bffc-43ba-804d-26a452f5e86a"). InnerVolumeSpecName "kube-api-access-gkdfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:00:14.730193 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.730167 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-788cd678cd-6t8zt"] Jun 14 23:00:14.732187 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:00:14.732161 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod886b86f7_6aec_4c0a_89da_94c0f71e95de.slice/crio-f7954b17718f7a60ae44a76069e5bd2c814c78a97c7ca129cd248a6960b00490 WatchSource:0}: Error finding container f7954b17718f7a60ae44a76069e5bd2c814c78a97c7ca129cd248a6960b00490: Status 404 returned error can't find the container with id f7954b17718f7a60ae44a76069e5bd2c814c78a97c7ca129cd248a6960b00490 Jun 14 23:00:14.797767 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.797705 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkdfm\" (UniqueName: \"kubernetes.io/projected/1c091cf4-bffc-43ba-804d-26a452f5e86a-kube-api-access-gkdfm\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:00:14.797767 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:14.797734 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwndd\" (UniqueName: \"kubernetes.io/projected/7cbc7caf-07b5-497f-85d8-1c5d220460b1-kube-api-access-gwndd\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:00:15.617041 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.617006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2nvmw" Jun 14 23:00:15.617041 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.617020 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-788cd678cd-6t8zt" event={"ID":"886b86f7-6aec-4c0a-89da-94c0f71e95de","Type":"ContainerStarted","Data":"1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220"} Jun 14 23:00:15.617558 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.617065 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-788cd678cd-6t8zt" event={"ID":"886b86f7-6aec-4c0a-89da-94c0f71e95de","Type":"ContainerStarted","Data":"f7954b17718f7a60ae44a76069e5bd2c814c78a97c7ca129cd248a6960b00490"} Jun 14 23:00:15.617558 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.617197 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-669579b5f8-rftgf" Jun 14 23:00:15.632463 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.632387 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-788cd678cd-6t8zt" podStartSLOduration=1.280518425 podStartE2EDuration="1.632371035s" totalImagesPullingTime="351.85261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:00:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:00:15.632322741 +0000 UTC m=+735.698705495" watchObservedRunningTime="2026-06-14 23:00:15.632371035 +0000 UTC m=+735.698753789" Jun 14 23:00:15.654092 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.654061 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nvmw"] Jun 14 23:00:15.660902 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.660856 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzpv2"] Jun 14 23:00:15.661104 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.661073 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-dzpv2" podUID="399f32b8-2f0c-4f4d-a941-66db62791694" containerName="authorino" containerID="cri-o://9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71" gracePeriod=30 Jun 14 23:00:15.664182 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.664088 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nvmw"] Jun 14 23:00:15.684989 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.684960 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-669579b5f8-rftgf"] Jun 14 23:00:15.688174 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.688137 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-669579b5f8-rftgf"] Jun 14 23:00:15.916712 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:15.916685 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dzpv2" Jun 14 23:00:16.008555 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.008515 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j54xx\" (UniqueName: \"kubernetes.io/projected/399f32b8-2f0c-4f4d-a941-66db62791694-kube-api-access-j54xx\") pod \"399f32b8-2f0c-4f4d-a941-66db62791694\" (UID: \"399f32b8-2f0c-4f4d-a941-66db62791694\") " Jun 14 23:00:16.010638 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.010611 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/399f32b8-2f0c-4f4d-a941-66db62791694-kube-api-access-j54xx" (OuterVolumeSpecName: "kube-api-access-j54xx") pod "399f32b8-2f0c-4f4d-a941-66db62791694" (UID: "399f32b8-2f0c-4f4d-a941-66db62791694"). InnerVolumeSpecName "kube-api-access-j54xx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:00:16.109830 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.109795 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j54xx\" (UniqueName: \"kubernetes.io/projected/399f32b8-2f0c-4f4d-a941-66db62791694-kube-api-access-j54xx\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:00:16.364418 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.364379 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c091cf4-bffc-43ba-804d-26a452f5e86a" path="/var/lib/kubelet/pods/1c091cf4-bffc-43ba-804d-26a452f5e86a/volumes" Jun 14 23:00:16.364709 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.364691 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cbc7caf-07b5-497f-85d8-1c5d220460b1" path="/var/lib/kubelet/pods/7cbc7caf-07b5-497f-85d8-1c5d220460b1/volumes" Jun 14 23:00:16.623131 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.623036 2568 generic.go:356] "Generic (PLEG): container finished" podID="399f32b8-2f0c-4f4d-a941-66db62791694" containerID="9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71" exitCode=0 Jun 14 23:00:16.623131 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.623077 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-dzpv2" Jun 14 23:00:16.623599 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.623124 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dzpv2" event={"ID":"399f32b8-2f0c-4f4d-a941-66db62791694","Type":"ContainerDied","Data":"9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71"} Jun 14 23:00:16.623599 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.623169 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-dzpv2" event={"ID":"399f32b8-2f0c-4f4d-a941-66db62791694","Type":"ContainerDied","Data":"b7c005bb0a2d4b8be0f4e011a29611fc33bd9d9e53780f251fc2679a88b70a84"} Jun 14 23:00:16.623599 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.623187 2568 scope.go:117] "RemoveContainer" containerID="9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71" Jun 14 23:00:16.631956 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.631929 2568 scope.go:117] "RemoveContainer" containerID="9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71" Jun 14 23:00:16.632215 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:00:16.632196 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71\": container with ID starting with 9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71 not found: ID does not exist" containerID="9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71" Jun 14 23:00:16.632273 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.632222 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71"} err="failed to get container status \"9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71\": rpc error: code = NotFound desc = could not find container \"9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71\": container with ID starting with 9437c463d5d7b31ca4953fd005dd18169273122e793726b33cef868238d52e71 not found: ID does not exist" Jun 14 23:00:16.638605 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.638582 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzpv2"] Jun 14 23:00:16.640471 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:16.640451 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-dzpv2"] Jun 14 23:00:18.364387 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:18.364355 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="399f32b8-2f0c-4f4d-a941-66db62791694" path="/var/lib/kubelet/pods/399f32b8-2f0c-4f4d-a941-66db62791694/volumes" Jun 14 23:00:19.038727 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.038689 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-687bfd8fb4-rq6tp"] Jun 14 23:00:19.039180 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.039159 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="399f32b8-2f0c-4f4d-a941-66db62791694" containerName="authorino" Jun 14 23:00:19.039274 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.039182 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="399f32b8-2f0c-4f4d-a941-66db62791694" containerName="authorino" Jun 14 23:00:19.039331 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.039298 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="399f32b8-2f0c-4f4d-a941-66db62791694" containerName="authorino" Jun 14 23:00:19.044458 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.044436 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:19.046988 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.046960 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 14 23:00:19.047137 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.047043 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fxn5t\"" Jun 14 23:00:19.047137 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.047046 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 14 23:00:19.053608 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.053574 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687bfd8fb4-rq6tp"] Jun 14 23:00:19.138892 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.138855 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2fl4\" (UniqueName: \"kubernetes.io/projected/24ce1473-9775-47e8-b788-8efd80c46416-kube-api-access-d2fl4\") pod \"maas-controller-687bfd8fb4-rq6tp\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:19.139070 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.138901 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert\") pod \"maas-controller-687bfd8fb4-rq6tp\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:19.222709 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.222679 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c87d57569-crjlr"] Jun 14 23:00:19.226630 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.226613 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:19.236093 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.236059 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c87d57569-crjlr"] Jun 14 23:00:19.240374 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.240347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2fl4\" (UniqueName: \"kubernetes.io/projected/24ce1473-9775-47e8-b788-8efd80c46416-kube-api-access-d2fl4\") pod \"maas-controller-687bfd8fb4-rq6tp\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:19.240494 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.240396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert\") pod \"maas-controller-687bfd8fb4-rq6tp\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:19.240620 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:00:19.240589 2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 14 23:00:19.240702 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:00:19.240690 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert podName:24ce1473-9775-47e8-b788-8efd80c46416 nodeName:}" failed. No retries permitted until 2026-06-14 23:00:19.740669569 +0000 UTC m=+739.807052310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert") pod "maas-controller-687bfd8fb4-rq6tp" (UID: "24ce1473-9775-47e8-b788-8efd80c46416") : secret "maas-controller-webhook-cert" not found Jun 14 23:00:19.253840 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.253797 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2fl4\" (UniqueName: \"kubernetes.io/projected/24ce1473-9775-47e8-b788-8efd80c46416-kube-api-access-d2fl4\") pod \"maas-controller-687bfd8fb4-rq6tp\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:19.341710 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.341630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5kw4\" (UniqueName: \"kubernetes.io/projected/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-kube-api-access-x5kw4\") pod \"maas-controller-6c87d57569-crjlr\" (UID: \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\") " pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:19.341881 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.341711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-webhook-cert\") pod \"maas-controller-6c87d57569-crjlr\" (UID: \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\") " pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:19.442623 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.442592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-webhook-cert\") pod \"maas-controller-6c87d57569-crjlr\" (UID: \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\") " pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:19.443029 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.442671 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5kw4\" (UniqueName: \"kubernetes.io/projected/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-kube-api-access-x5kw4\") pod \"maas-controller-6c87d57569-crjlr\" (UID: \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\") " pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:19.445082 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.445062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-webhook-cert\") pod \"maas-controller-6c87d57569-crjlr\" (UID: \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\") " pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:19.450255 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.450237 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5kw4\" (UniqueName: \"kubernetes.io/projected/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-kube-api-access-x5kw4\") pod \"maas-controller-6c87d57569-crjlr\" (UID: \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\") " pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:19.539071 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.539035 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:19.675980 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.675957 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c87d57569-crjlr"] Jun 14 23:00:19.678034 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:00:19.678008 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2f6bc9_d510_4eec_b017_41e4cbc222bc.slice/crio-48d84cb4769d3bde85ae65cbb03ee1fc5d1b795ef84bc6fd27c84dbec6de0b4b WatchSource:0}: Error finding container 48d84cb4769d3bde85ae65cbb03ee1fc5d1b795ef84bc6fd27c84dbec6de0b4b: Status 404 returned error can't find the container with id 48d84cb4769d3bde85ae65cbb03ee1fc5d1b795ef84bc6fd27c84dbec6de0b4b Jun 14 23:00:19.745978 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.745942 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert\") pod \"maas-controller-687bfd8fb4-rq6tp\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:19.748460 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.748434 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert\") pod \"maas-controller-687bfd8fb4-rq6tp\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:19.956771 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:19.956722 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:20.086581 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:20.086556 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-687bfd8fb4-rq6tp"] Jun 14 23:00:20.088628 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:00:20.088600 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ce1473_9775_47e8_b788_8efd80c46416.slice/crio-4226a5fd39fbc78f8a41962401bce0b621013505724d2d04c1d539779423e6a8 WatchSource:0}: Error finding container 4226a5fd39fbc78f8a41962401bce0b621013505724d2d04c1d539779423e6a8: Status 404 returned error can't find the container with id 4226a5fd39fbc78f8a41962401bce0b621013505724d2d04c1d539779423e6a8 Jun 14 23:00:20.653208 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:20.653165 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c87d57569-crjlr" event={"ID":"2e2f6bc9-d510-4eec-b017-41e4cbc222bc","Type":"ContainerStarted","Data":"48d84cb4769d3bde85ae65cbb03ee1fc5d1b795ef84bc6fd27c84dbec6de0b4b"} Jun 14 23:00:20.655059 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:20.654994 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" event={"ID":"24ce1473-9775-47e8-b788-8efd80c46416","Type":"ContainerStarted","Data":"4226a5fd39fbc78f8a41962401bce0b621013505724d2d04c1d539779423e6a8"} Jun 14 23:00:23.676289 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:23.676246 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c87d57569-crjlr" event={"ID":"2e2f6bc9-d510-4eec-b017-41e4cbc222bc","Type":"ContainerStarted","Data":"b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482"} Jun 14 23:00:23.676815 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:23.676375 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:23.677944 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:23.677917 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" event={"ID":"24ce1473-9775-47e8-b788-8efd80c46416","Type":"ContainerStarted","Data":"7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c"} Jun 14 23:00:23.678073 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:23.677973 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:23.719499 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:23.719446 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c87d57569-crjlr" podStartSLOduration=1.43301807 podStartE2EDuration="4.719431472s" totalImagesPullingTime="3.286413402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:00:23.717055563 +0000 UTC m=+743.783438328" watchObservedRunningTime="2026-06-14 23:00:23.719431472 +0000 UTC m=+743.785814227" Jun 14 23:00:23.760063 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:23.760012 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" podStartSLOduration=1.876871859 podStartE2EDuration="4.759996649s" totalImagesPullingTime="2.88312479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:00:23.752039361 +0000 UTC m=+743.818422127" watchObservedRunningTime="2026-06-14 23:00:23.759996649 +0000 UTC m=+743.826379405" Jun 14 23:00:34.688737 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:34.688704 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:00:34.689171 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:34.688809 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:34.746816 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:34.746781 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-687bfd8fb4-rq6tp"] Jun 14 23:00:34.747037 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:34.747013 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" podUID="24ce1473-9775-47e8-b788-8efd80c46416" containerName="manager" containerID="cri-o://7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c" gracePeriod=30 Jun 14 23:00:34.993062 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:34.993039 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:35.091339 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.091309 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert\") pod \"24ce1473-9775-47e8-b788-8efd80c46416\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " Jun 14 23:00:35.091512 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.091386 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2fl4\" (UniqueName: \"kubernetes.io/projected/24ce1473-9775-47e8-b788-8efd80c46416-kube-api-access-d2fl4\") pod \"24ce1473-9775-47e8-b788-8efd80c46416\" (UID: \"24ce1473-9775-47e8-b788-8efd80c46416\") " Jun 14 23:00:35.093503 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.093474 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "24ce1473-9775-47e8-b788-8efd80c46416" (UID: "24ce1473-9775-47e8-b788-8efd80c46416"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 23:00:35.093668 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.093651 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24ce1473-9775-47e8-b788-8efd80c46416-kube-api-access-d2fl4" (OuterVolumeSpecName: "kube-api-access-d2fl4") pod "24ce1473-9775-47e8-b788-8efd80c46416" (UID: "24ce1473-9775-47e8-b788-8efd80c46416"). InnerVolumeSpecName "kube-api-access-d2fl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:00:35.192414 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.192384 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2fl4\" (UniqueName: \"kubernetes.io/projected/24ce1473-9775-47e8-b788-8efd80c46416-kube-api-access-d2fl4\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:00:35.192414 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.192409 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24ce1473-9775-47e8-b788-8efd80c46416-webhook-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:00:35.744404 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.744366 2568 generic.go:356] "Generic (PLEG): container finished" podID="24ce1473-9775-47e8-b788-8efd80c46416" containerID="7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c" exitCode=0 Jun 14 23:00:35.744864 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.744415 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" Jun 14 23:00:35.744864 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.744448 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" event={"ID":"24ce1473-9775-47e8-b788-8efd80c46416","Type":"ContainerDied","Data":"7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c"} Jun 14 23:00:35.744864 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.744501 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-687bfd8fb4-rq6tp" event={"ID":"24ce1473-9775-47e8-b788-8efd80c46416","Type":"ContainerDied","Data":"4226a5fd39fbc78f8a41962401bce0b621013505724d2d04c1d539779423e6a8"} Jun 14 23:00:35.744864 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.744523 2568 scope.go:117] "RemoveContainer" containerID="7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c" Jun 14 23:00:35.753785 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.753539 2568 scope.go:117] "RemoveContainer" containerID="7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c" Jun 14 23:00:35.753874 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:00:35.753854 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c\": container with ID starting with 7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c not found: ID does not exist" containerID="7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c" Jun 14 23:00:35.753932 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.753887 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c"} err="failed to get container status \"7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c\": rpc error: code = NotFound desc = could not find container \"7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c\": container with ID starting with 7eb92e81ca24be52a46b76ea797374a96502613248b56a55b4d1051b5851330c not found: ID does not exist" Jun 14 23:00:35.765041 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.765015 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-687bfd8fb4-rq6tp"] Jun 14 23:00:35.768569 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:35.768543 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-687bfd8fb4-rq6tp"] Jun 14 23:00:36.363997 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:36.363963 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24ce1473-9775-47e8-b788-8efd80c46416" path="/var/lib/kubelet/pods/24ce1473-9775-47e8-b788-8efd80c46416/volumes" Jun 14 23:00:54.503584 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.503549 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-585bd99f8d-rk6wq"] Jun 14 23:00:54.504115 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.504057 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24ce1473-9775-47e8-b788-8efd80c46416" containerName="manager" Jun 14 23:00:54.504115 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.504073 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="24ce1473-9775-47e8-b788-8efd80c46416" containerName="manager" Jun 14 23:00:54.504239 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.504137 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="24ce1473-9775-47e8-b788-8efd80c46416" containerName="manager" Jun 14 23:00:54.512311 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.512292 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.515931 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.515905 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 14 23:00:54.516049 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.515944 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-bwv4g\"" Jun 14 23:00:54.517345 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.517318 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-585bd99f8d-rk6wq"] Jun 14 23:00:54.570846 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.570821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8f0d43-c99e-4972-9307-e179cfa92d79-maas-api-tls\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.570995 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.570860 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8f0d43-c99e-4972-9307-e179cfa92d79-openshift-service-ca\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.570995 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.570933 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xngh\" (UniqueName: \"kubernetes.io/projected/8c8f0d43-c99e-4972-9307-e179cfa92d79-kube-api-access-8xngh\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.671946 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.671912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xngh\" (UniqueName: \"kubernetes.io/projected/8c8f0d43-c99e-4972-9307-e179cfa92d79-kube-api-access-8xngh\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.672103 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.671985 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8f0d43-c99e-4972-9307-e179cfa92d79-maas-api-tls\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.672103 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.672011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8f0d43-c99e-4972-9307-e179cfa92d79-openshift-service-ca\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.672593 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.672569 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8c8f0d43-c99e-4972-9307-e179cfa92d79-openshift-service-ca\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.674594 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.674573 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8c8f0d43-c99e-4972-9307-e179cfa92d79-maas-api-tls\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.679791 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.679770 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xngh\" (UniqueName: \"kubernetes.io/projected/8c8f0d43-c99e-4972-9307-e179cfa92d79-kube-api-access-8xngh\") pod \"maas-api-585bd99f8d-rk6wq\" (UID: \"8c8f0d43-c99e-4972-9307-e179cfa92d79\") " pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.824397 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.824319 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:54.869557 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.869520 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wrmgf"] Jun 14 23:00:54.873201 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.873167 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" Jun 14 23:00:54.876695 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.876175 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ckspk\"" Jun 14 23:00:54.876695 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.876412 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 14 23:00:54.885139 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.885022 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wrmgf"] Jun 14 23:00:54.907989 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.907957 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-pw27m"] Jun 14 23:00:54.910675 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.910649 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" Jun 14 23:00:54.921291 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.921264 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-pw27m"] Jun 14 23:00:54.974043 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.974018 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-585bd99f8d-rk6wq"] Jun 14 23:00:54.974497 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.974468 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8rl2\" (UniqueName: \"kubernetes.io/projected/a9b8c865-9c0c-46dc-a828-8f8cf1396717-kube-api-access-j8rl2\") pod \"payload-pre-processing-579785bc64-wrmgf\" (UID: \"a9b8c865-9c0c-46dc-a828-8f8cf1396717\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" Jun 14 23:00:54.974633 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:54.974568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24s7m\" (UniqueName: \"kubernetes.io/projected/8aed2e83-9e89-469a-9c50-0d01cc04b22a-kube-api-access-24s7m\") pod \"payload-processing-699b6cd6c-pw27m\" (UID: \"8aed2e83-9e89-469a-9c50-0d01cc04b22a\") " pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" Jun 14 23:00:54.976131 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:00:54.976110 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8f0d43_c99e_4972_9307_e179cfa92d79.slice/crio-ea5ba218716880f64d8df49ea6a05f16bf5b1b7c52d05c6392d4f19aac3b9ae6 WatchSource:0}: Error finding container ea5ba218716880f64d8df49ea6a05f16bf5b1b7c52d05c6392d4f19aac3b9ae6: Status 404 returned error can't find the container with id ea5ba218716880f64d8df49ea6a05f16bf5b1b7c52d05c6392d4f19aac3b9ae6 Jun 14 23:00:55.075633 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.075532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8rl2\" (UniqueName: \"kubernetes.io/projected/a9b8c865-9c0c-46dc-a828-8f8cf1396717-kube-api-access-j8rl2\") pod \"payload-pre-processing-579785bc64-wrmgf\" (UID: \"a9b8c865-9c0c-46dc-a828-8f8cf1396717\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" Jun 14 23:00:55.075633 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.075627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24s7m\" (UniqueName: \"kubernetes.io/projected/8aed2e83-9e89-469a-9c50-0d01cc04b22a-kube-api-access-24s7m\") pod \"payload-processing-699b6cd6c-pw27m\" (UID: \"8aed2e83-9e89-469a-9c50-0d01cc04b22a\") " pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" Jun 14 23:00:55.084151 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.084118 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24s7m\" (UniqueName: \"kubernetes.io/projected/8aed2e83-9e89-469a-9c50-0d01cc04b22a-kube-api-access-24s7m\") pod \"payload-processing-699b6cd6c-pw27m\" (UID: \"8aed2e83-9e89-469a-9c50-0d01cc04b22a\") " pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" Jun 14 23:00:55.084288 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.084203 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8rl2\" (UniqueName: \"kubernetes.io/projected/a9b8c865-9c0c-46dc-a828-8f8cf1396717-kube-api-access-j8rl2\") pod \"payload-pre-processing-579785bc64-wrmgf\" (UID: \"a9b8c865-9c0c-46dc-a828-8f8cf1396717\") " pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" Jun 14 23:00:55.191252 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.191217 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" Jun 14 23:00:55.222337 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.222309 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" Jun 14 23:00:55.339358 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.339333 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-wrmgf"] Jun 14 23:00:55.343548 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:00:55.343500 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9b8c865_9c0c_46dc_a828_8f8cf1396717.slice/crio-2da46741e99cf659ab357619bff7a9b227051c9bd05eb715094da1dfbfbe3552 WatchSource:0}: Error finding container 2da46741e99cf659ab357619bff7a9b227051c9bd05eb715094da1dfbfbe3552: Status 404 returned error can't find the container with id 2da46741e99cf659ab357619bff7a9b227051c9bd05eb715094da1dfbfbe3552 Jun 14 23:00:55.370050 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.370026 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-pw27m"] Jun 14 23:00:55.371943 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:00:55.371918 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aed2e83_9e89_469a_9c50_0d01cc04b22a.slice/crio-1979e1c750da6f6605e20049b4a0a6b9b2b161e4ca2127d219d7920fbed49956 WatchSource:0}: Error finding container 1979e1c750da6f6605e20049b4a0a6b9b2b161e4ca2127d219d7920fbed49956: Status 404 returned error can't find the container with id 1979e1c750da6f6605e20049b4a0a6b9b2b161e4ca2127d219d7920fbed49956 Jun 14 23:00:55.850067 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.850029 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" event={"ID":"8aed2e83-9e89-469a-9c50-0d01cc04b22a","Type":"ContainerStarted","Data":"1979e1c750da6f6605e20049b4a0a6b9b2b161e4ca2127d219d7920fbed49956"} Jun 14 23:00:55.851428 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.851399 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" event={"ID":"a9b8c865-9c0c-46dc-a828-8f8cf1396717","Type":"ContainerStarted","Data":"2da46741e99cf659ab357619bff7a9b227051c9bd05eb715094da1dfbfbe3552"} Jun 14 23:00:55.852684 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:55.852651 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-585bd99f8d-rk6wq" event={"ID":"8c8f0d43-c99e-4972-9307-e179cfa92d79","Type":"ContainerStarted","Data":"ea5ba218716880f64d8df49ea6a05f16bf5b1b7c52d05c6392d4f19aac3b9ae6"} Jun 14 23:00:58.874726 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.874689 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" event={"ID":"8aed2e83-9e89-469a-9c50-0d01cc04b22a","Type":"ContainerStarted","Data":"69a2996c8867bd83d0289d69717d5e6e82f6a651a616b059fb1e0e64a26a95b8"} Jun 14 23:00:58.875167 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.874815 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" Jun 14 23:00:58.876247 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.876224 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" event={"ID":"a9b8c865-9c0c-46dc-a828-8f8cf1396717","Type":"ContainerStarted","Data":"d4a8e4d4cd5290c2fb867c64cfca7634119e5a7235ed457409330312536f74c6"} Jun 14 23:00:58.876329 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.876279 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" Jun 14 23:00:58.877758 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.877722 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-585bd99f8d-rk6wq" event={"ID":"8c8f0d43-c99e-4972-9307-e179cfa92d79","Type":"ContainerStarted","Data":"06807a9c2efcd9137580d62aa4b6a8edd5ceca42244e82825d6b1d6cf123b710"} Jun 14 23:00:58.877895 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.877859 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:00:58.892974 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.892931 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" podStartSLOduration=2.246730641 podStartE2EDuration="4.89291797s" totalImagesPullingTime="2.646187329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:00:58.890276424 +0000 UTC m=+778.956659216" watchObservedRunningTime="2026-06-14 23:00:58.89291797 +0000 UTC m=+778.959300734" Jun 14 23:00:58.905184 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.905142 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-585bd99f8d-rk6wq" podStartSLOduration=1.92068346 podStartE2EDuration="4.905126183s" totalImagesPullingTime="2.984442723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:00:58.904503694 +0000 UTC m=+778.970886449" watchObservedRunningTime="2026-06-14 23:00:58.905126183 +0000 UTC m=+778.971508939" Jun 14 23:00:58.920039 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:00:58.919996 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" podStartSLOduration=2.240089549 podStartE2EDuration="4.919980214s" totalImagesPullingTime="2.679890665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:00:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:00:58.917500751 +0000 UTC m=+778.983883504" watchObservedRunningTime="2026-06-14 23:00:58.919980214 +0000 UTC m=+778.986362969" Jun 14 23:01:04.889475 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:04.889446 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-585bd99f8d-rk6wq" Jun 14 23:01:06.064827 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:06.064785 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 23:01:06.065643 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:06.065608 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" containerID="cri-o://edb7e7c7a05cf23afba1262187de98712b6c38291f75606e0328808f3ebf6f74" gracePeriod=30 Jun 14 23:01:07.927724 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:07.927693 2568 generic.go:356] "Generic (PLEG): container finished" podID="909328ce-d109-4018-8f34-a18e93149f6e" containerID="edb7e7c7a05cf23afba1262187de98712b6c38291f75606e0328808f3ebf6f74" exitCode=143 Jun 14 23:01:07.928107 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:07.927731 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"909328ce-d109-4018-8f34-a18e93149f6e","Type":"ContainerDied","Data":"edb7e7c7a05cf23afba1262187de98712b6c38291f75606e0328808f3ebf6f74"} Jun 14 23:01:08.115021 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.114999 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:08.196050 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.195965 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twbrx\" (UniqueName: \"kubernetes.io/projected/909328ce-d109-4018-8f34-a18e93149f6e-kube-api-access-twbrx\") pod \"909328ce-d109-4018-8f34-a18e93149f6e\" (UID: \"909328ce-d109-4018-8f34-a18e93149f6e\") " Jun 14 23:01:08.198128 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.198105 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/909328ce-d109-4018-8f34-a18e93149f6e-kube-api-access-twbrx" (OuterVolumeSpecName: "kube-api-access-twbrx") pod "909328ce-d109-4018-8f34-a18e93149f6e" (UID: "909328ce-d109-4018-8f34-a18e93149f6e"). InnerVolumeSpecName "kube-api-access-twbrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:01:08.297171 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.297140 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twbrx\" (UniqueName: \"kubernetes.io/projected/909328ce-d109-4018-8f34-a18e93149f6e-kube-api-access-twbrx\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:01:08.934883 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.934848 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"909328ce-d109-4018-8f34-a18e93149f6e","Type":"ContainerDied","Data":"8a0d4d6e46ea264dad742752b2d53451a2495426959c760ed13443473bd8c10c"} Jun 14 23:01:08.935324 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.934908 2568 scope.go:117] "RemoveContainer" containerID="edb7e7c7a05cf23afba1262187de98712b6c38291f75606e0328808f3ebf6f74" Jun 14 23:01:08.935324 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.934862 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:08.950588 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.950558 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 23:01:08.953649 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.953625 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 23:01:08.973900 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.973875 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 23:01:08.974368 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.974349 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" Jun 14 23:01:08.974368 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.974367 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" Jun 14 23:01:08.974543 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.974455 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="909328ce-d109-4018-8f34-a18e93149f6e" containerName="keycloak" Jun 14 23:01:08.978815 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.978800 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:08.981436 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.981419 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 14 23:01:08.981685 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.981667 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 14 23:01:08.981781 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.981689 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 14 23:01:08.981781 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.981693 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 14 23:01:08.982087 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.982072 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-frfxp\"" Jun 14 23:01:08.988294 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:08.988274 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 23:01:09.101853 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.101820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4ba3ccd7-a646-42d4-840c-e3a30d40643d-test-realms\") pod \"maas-keycloak-0\" (UID: \"4ba3ccd7-a646-42d4-840c-e3a30d40643d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:09.101994 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.101932 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjcwn\" (UniqueName: \"kubernetes.io/projected/4ba3ccd7-a646-42d4-840c-e3a30d40643d-kube-api-access-zjcwn\") pod \"maas-keycloak-0\" (UID: \"4ba3ccd7-a646-42d4-840c-e3a30d40643d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:09.202874 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.202780 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4ba3ccd7-a646-42d4-840c-e3a30d40643d-test-realms\") pod \"maas-keycloak-0\" (UID: \"4ba3ccd7-a646-42d4-840c-e3a30d40643d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:09.203053 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.202908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjcwn\" (UniqueName: \"kubernetes.io/projected/4ba3ccd7-a646-42d4-840c-e3a30d40643d-kube-api-access-zjcwn\") pod \"maas-keycloak-0\" (UID: \"4ba3ccd7-a646-42d4-840c-e3a30d40643d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:09.203485 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.203463 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4ba3ccd7-a646-42d4-840c-e3a30d40643d-test-realms\") pod \"maas-keycloak-0\" (UID: \"4ba3ccd7-a646-42d4-840c-e3a30d40643d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:09.210121 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.210098 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjcwn\" (UniqueName: \"kubernetes.io/projected/4ba3ccd7-a646-42d4-840c-e3a30d40643d-kube-api-access-zjcwn\") pod \"maas-keycloak-0\" (UID: \"4ba3ccd7-a646-42d4-840c-e3a30d40643d\") " pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:09.289735 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.289705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:09.436836 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.436811 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 14 23:01:09.439175 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:01:09.439148 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba3ccd7_a646_42d4_840c_e3a30d40643d.slice/crio-075e6c155d3b07923d8134c3446822ea692f5276a5a53408ce327ebce7eed529 WatchSource:0}: Error finding container 075e6c155d3b07923d8134c3446822ea692f5276a5a53408ce327ebce7eed529: Status 404 returned error can't find the container with id 075e6c155d3b07923d8134c3446822ea692f5276a5a53408ce327ebce7eed529 Jun 14 23:01:09.885491 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.885463 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-pw27m" Jun 14 23:01:09.885720 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.885702 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-wrmgf" Jun 14 23:01:09.944934 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.944896 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4ba3ccd7-a646-42d4-840c-e3a30d40643d","Type":"ContainerStarted","Data":"42b0138771f5fc31524d655833e2f0219f40ba655773c027f606323954f493a4"} Jun 14 23:01:09.945420 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.944953 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4ba3ccd7-a646-42d4-840c-e3a30d40643d","Type":"ContainerStarted","Data":"075e6c155d3b07923d8134c3446822ea692f5276a5a53408ce327ebce7eed529"} Jun 14 23:01:09.962180 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:09.962130 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.682583275 podStartE2EDuration="1.962112147s" totalImagesPullingTime="279.528872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:01:09.961140136 +0000 UTC m=+790.027522891" watchObservedRunningTime="2026-06-14 23:01:09.962112147 +0000 UTC m=+790.028494902" Jun 14 23:01:10.290151 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:10.290113 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:10.291666 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:10.291619 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:10.366899 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:10.366858 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="909328ce-d109-4018-8f34-a18e93149f6e" path="/var/lib/kubelet/pods/909328ce-d109-4018-8f34-a18e93149f6e/volumes" Jun 14 23:01:11.291282 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:11.291223 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:12.290290 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:12.290240 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:13.291014 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:13.290967 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:14.290789 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:14.290706 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:15.291009 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:15.290966 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:16.290920 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:16.290869 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:17.291060 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:17.290948 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:18.290296 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:18.290250 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:19.289962 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:19.289921 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:19.290459 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:19.290291 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:20.290263 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:20.290208 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:21.290147 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:21.290109 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:22.290354 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:22.290306 2568 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.51:9000/health/started\": dial tcp 10.134.0.51:9000: connect: connection refused" Jun 14 23:01:23.418125 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:23.418078 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:23.437089 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:23.437038 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4ba3ccd7-a646-42d4-840c-e3a30d40643d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 14 23:01:33.424409 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:33.424372 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 14 23:01:44.093470 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.093406 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f68c9b84-c2kpq"] Jun 14 23:01:44.098906 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.098885 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.101116 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.101097 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 14 23:01:44.106090 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.106066 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f68c9b84-c2kpq"] Jun 14 23:01:44.160188 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.160158 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/35e2c815-474e-4e5a-9b1e-7592c5528c39-oidc-ca\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.160360 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.160196 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35e2c815-474e-4e5a-9b1e-7592c5528c39-tls-cert\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.160360 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.160327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9dnj\" (UniqueName: \"kubernetes.io/projected/35e2c815-474e-4e5a-9b1e-7592c5528c39-kube-api-access-z9dnj\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.260834 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.260803 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9dnj\" (UniqueName: \"kubernetes.io/projected/35e2c815-474e-4e5a-9b1e-7592c5528c39-kube-api-access-z9dnj\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.260998 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.260860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/35e2c815-474e-4e5a-9b1e-7592c5528c39-oidc-ca\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.260998 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.260894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35e2c815-474e-4e5a-9b1e-7592c5528c39-tls-cert\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.261439 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.261418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/35e2c815-474e-4e5a-9b1e-7592c5528c39-oidc-ca\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.263422 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.263405 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35e2c815-474e-4e5a-9b1e-7592c5528c39-tls-cert\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.268446 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.268425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9dnj\" (UniqueName: \"kubernetes.io/projected/35e2c815-474e-4e5a-9b1e-7592c5528c39-kube-api-access-z9dnj\") pod \"authorino-57f68c9b84-c2kpq\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.410505 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.410394 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:01:44.542873 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:44.542847 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f68c9b84-c2kpq"] Jun 14 23:01:44.544440 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:01:44.544413 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35e2c815_474e_4e5a_9b1e_7592c5528c39.slice/crio-818be0dc0dfdb2edc87fb5eaa00d985f6f508932fe1c8f50b313752e8360c98d WatchSource:0}: Error finding container 818be0dc0dfdb2edc87fb5eaa00d985f6f508932fe1c8f50b313752e8360c98d: Status 404 returned error can't find the container with id 818be0dc0dfdb2edc87fb5eaa00d985f6f508932fe1c8f50b313752e8360c98d Jun 14 23:01:45.178086 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.178056 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" event={"ID":"35e2c815-474e-4e5a-9b1e-7592c5528c39","Type":"ContainerStarted","Data":"e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5"} Jun 14 23:01:45.178486 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.178098 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" event={"ID":"35e2c815-474e-4e5a-9b1e-7592c5528c39","Type":"ContainerStarted","Data":"818be0dc0dfdb2edc87fb5eaa00d985f6f508932fe1c8f50b313752e8360c98d"} Jun 14 23:01:45.193296 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.193246 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" podStartSLOduration=0.896364674 podStartE2EDuration="1.193229145s" totalImagesPullingTime="296.864471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:01:45.190972977 +0000 UTC m=+825.257355730" watchObservedRunningTime="2026-06-14 23:01:45.193229145 +0000 UTC m=+825.259611936" Jun 14 23:01:45.217311 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.217281 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-788cd678cd-6t8zt"] Jun 14 23:01:45.217472 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.217446 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-788cd678cd-6t8zt" podUID="886b86f7-6aec-4c0a-89da-94c0f71e95de" containerName="authorino" containerID="cri-o://1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220" gracePeriod=30 Jun 14 23:01:45.470540 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.470517 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:01:45.573592 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.573560 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/886b86f7-6aec-4c0a-89da-94c0f71e95de-tls-cert\") pod \"886b86f7-6aec-4c0a-89da-94c0f71e95de\" (UID: \"886b86f7-6aec-4c0a-89da-94c0f71e95de\") " Jun 14 23:01:45.573826 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.573631 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7q8s\" (UniqueName: \"kubernetes.io/projected/886b86f7-6aec-4c0a-89da-94c0f71e95de-kube-api-access-q7q8s\") pod \"886b86f7-6aec-4c0a-89da-94c0f71e95de\" (UID: \"886b86f7-6aec-4c0a-89da-94c0f71e95de\") " Jun 14 23:01:45.575728 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.575693 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/886b86f7-6aec-4c0a-89da-94c0f71e95de-kube-api-access-q7q8s" (OuterVolumeSpecName: "kube-api-access-q7q8s") pod "886b86f7-6aec-4c0a-89da-94c0f71e95de" (UID: "886b86f7-6aec-4c0a-89da-94c0f71e95de"). InnerVolumeSpecName "kube-api-access-q7q8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:01:45.584352 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.584328 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/886b86f7-6aec-4c0a-89da-94c0f71e95de-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "886b86f7-6aec-4c0a-89da-94c0f71e95de" (UID: "886b86f7-6aec-4c0a-89da-94c0f71e95de"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 23:01:45.675230 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.675195 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7q8s\" (UniqueName: \"kubernetes.io/projected/886b86f7-6aec-4c0a-89da-94c0f71e95de-kube-api-access-q7q8s\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:01:45.675230 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:45.675225 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/886b86f7-6aec-4c0a-89da-94c0f71e95de-tls-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:01:46.184942 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.184903 2568 generic.go:356] "Generic (PLEG): container finished" podID="886b86f7-6aec-4c0a-89da-94c0f71e95de" containerID="1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220" exitCode=0 Jun 14 23:01:46.185413 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.184965 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-788cd678cd-6t8zt" Jun 14 23:01:46.185413 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.184992 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-788cd678cd-6t8zt" event={"ID":"886b86f7-6aec-4c0a-89da-94c0f71e95de","Type":"ContainerDied","Data":"1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220"} Jun 14 23:01:46.185413 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.185038 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-788cd678cd-6t8zt" event={"ID":"886b86f7-6aec-4c0a-89da-94c0f71e95de","Type":"ContainerDied","Data":"f7954b17718f7a60ae44a76069e5bd2c814c78a97c7ca129cd248a6960b00490"} Jun 14 23:01:46.185413 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.185056 2568 scope.go:117] "RemoveContainer" containerID="1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220" Jun 14 23:01:46.194710 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.194696 2568 scope.go:117] "RemoveContainer" containerID="1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220" Jun 14 23:01:46.194961 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:01:46.194941 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220\": container with ID starting with 1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220 not found: ID does not exist" containerID="1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220" Jun 14 23:01:46.195027 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.194969 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220"} err="failed to get container status \"1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220\": rpc error: code = NotFound desc = could not find container \"1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220\": container with ID starting with 1bcc093382ce10b85a2c31dc0bd2c5a2796391d7b4cd676f05add52070ebc220 not found: ID does not exist" Jun 14 23:01:46.212950 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.212924 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-788cd678cd-6t8zt"] Jun 14 23:01:46.223610 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.223583 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-788cd678cd-6t8zt"] Jun 14 23:01:46.365418 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:46.365389 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="886b86f7-6aec-4c0a-89da-94c0f71e95de" path="/var/lib/kubelet/pods/886b86f7-6aec-4c0a-89da-94c0f71e95de/volumes" Jun 14 23:01:52.076501 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.076465 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk"] Jun 14 23:01:52.076990 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.076889 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="886b86f7-6aec-4c0a-89da-94c0f71e95de" containerName="authorino" Jun 14 23:01:52.076990 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.076903 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="886b86f7-6aec-4c0a-89da-94c0f71e95de" containerName="authorino" Jun 14 23:01:52.076990 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.076974 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="886b86f7-6aec-4c0a-89da-94c0f71e95de" containerName="authorino" Jun 14 23:01:52.080134 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.080116 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.082366 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.082350 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 14 23:01:52.083304 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.083286 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 14 23:01:52.083428 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.083303 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 14 23:01:52.083428 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.083333 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-h577z\"" Jun 14 23:01:52.091154 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.091126 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk"] Jun 14 23:01:52.238700 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.238662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79nb4\" (UniqueName: \"kubernetes.io/projected/f64e5301-8838-4645-a637-2e02426b7443-kube-api-access-79nb4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.238879 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.238713 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f64e5301-8838-4645-a637-2e02426b7443-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.238879 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.238866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.238982 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.238901 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.238982 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.238955 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.238982 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.238971 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340011 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.339918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340011 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.339965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340221 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.340019 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340221 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.340043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340221 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.340197 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nb4\" (UniqueName: \"kubernetes.io/projected/f64e5301-8838-4645-a637-2e02426b7443-kube-api-access-79nb4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340375 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.340248 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f64e5301-8838-4645-a637-2e02426b7443-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340429 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.340395 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340429 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.340411 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.340532 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.340504 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.342269 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.342244 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f64e5301-8838-4645-a637-2e02426b7443-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.342544 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.342525 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f64e5301-8838-4645-a637-2e02426b7443-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.347494 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.347476 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79nb4\" (UniqueName: \"kubernetes.io/projected/f64e5301-8838-4645-a637-2e02426b7443-kube-api-access-79nb4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk\" (UID: \"f64e5301-8838-4645-a637-2e02426b7443\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.397095 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.397066 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" Jun 14 23:01:52.540239 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:52.540205 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk"] Jun 14 23:01:52.542612 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:01:52.542564 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf64e5301_8838_4645_a637_2e02426b7443.slice/crio-08d8cc3e3fd5145e26f804241a7ce09db7d5289a6212e19634fab69f9c41b101 WatchSource:0}: Error finding container 08d8cc3e3fd5145e26f804241a7ce09db7d5289a6212e19634fab69f9c41b101: Status 404 returned error can't find the container with id 08d8cc3e3fd5145e26f804241a7ce09db7d5289a6212e19634fab69f9c41b101 Jun 14 23:01:53.225278 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:53.225239 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" event={"ID":"f64e5301-8838-4645-a637-2e02426b7443","Type":"ContainerStarted","Data":"08d8cc3e3fd5145e26f804241a7ce09db7d5289a6212e19634fab69f9c41b101"} Jun 14 23:01:56.250768 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:01:56.250718 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk" event={"ID":"f64e5301-8838-4645-a637-2e02426b7443","Type":"ContainerStarted","Data":"060e4c50f45a581c809f4ad2ee96674392369352bfc6f9651489154c5d7939aa"} Jun 14 23:02:14.879427 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.879394 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg"] Jun 14 23:02:14.886608 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.886585 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:14.888828 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.888808 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 14 23:02:14.892862 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.892837 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg"] Jun 14 23:02:14.938792 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.938756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:14.938954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.938810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:14.938954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.938839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:14.938954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.938870 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:14.938954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.938923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0e1f89-918b-4084-9c71-3d38a75ba810-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:14.939113 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:14.938958 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjwdc\" (UniqueName: \"kubernetes.io/projected/fe0e1f89-918b-4084-9c71-3d38a75ba810-kube-api-access-wjwdc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040100 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040057 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040278 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040278 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0e1f89-918b-4084-9c71-3d38a75ba810-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040394 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040293 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjwdc\" (UniqueName: \"kubernetes.io/projected/fe0e1f89-918b-4084-9c71-3d38a75ba810-kube-api-access-wjwdc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040394 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040382 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040506 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040446 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040559 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040518 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040607 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040562 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.040764 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.040724 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.042616 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.042589 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe0e1f89-918b-4084-9c71-3d38a75ba810-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.042812 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.042794 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe0e1f89-918b-4084-9c71-3d38a75ba810-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.047672 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.047649 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjwdc\" (UniqueName: \"kubernetes.io/projected/fe0e1f89-918b-4084-9c71-3d38a75ba810-kube-api-access-wjwdc\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg\" (UID: \"fe0e1f89-918b-4084-9c71-3d38a75ba810\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.197813 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.197774 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:15.347652 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:15.347627 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg"] Jun 14 23:02:15.349986 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:02:15.349953 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0e1f89_918b_4084_9c71_3d38a75ba810.slice/crio-dd38e46bb14b21a85ac587a27e276816eb9d7b5a29743bba69f47f4470aa80fb WatchSource:0}: Error finding container dd38e46bb14b21a85ac587a27e276816eb9d7b5a29743bba69f47f4470aa80fb: Status 404 returned error can't find the container with id dd38e46bb14b21a85ac587a27e276816eb9d7b5a29743bba69f47f4470aa80fb Jun 14 23:02:16.364386 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:16.364355 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" event={"ID":"fe0e1f89-918b-4084-9c71-3d38a75ba810","Type":"ContainerStarted","Data":"6b8186232bb2336c91abe95695e9a4f9d881397292164dc8dd2e6ec2d282a4f8"} Jun 14 23:02:16.364778 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:16.364405 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" event={"ID":"fe0e1f89-918b-4084-9c71-3d38a75ba810","Type":"ContainerStarted","Data":"dd38e46bb14b21a85ac587a27e276816eb9d7b5a29743bba69f47f4470aa80fb"} Jun 14 23:02:17.366518 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:17.366480 2568 generic.go:356] "Generic (PLEG): container finished" podID="fe0e1f89-918b-4084-9c71-3d38a75ba810" containerID="6b8186232bb2336c91abe95695e9a4f9d881397292164dc8dd2e6ec2d282a4f8" exitCode=0 Jun 14 23:02:17.366983 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:17.366526 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" event={"ID":"fe0e1f89-918b-4084-9c71-3d38a75ba810","Type":"ContainerDied","Data":"6b8186232bb2336c91abe95695e9a4f9d881397292164dc8dd2e6ec2d282a4f8"} Jun 14 23:02:19.379576 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:19.379539 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" event={"ID":"fe0e1f89-918b-4084-9c71-3d38a75ba810","Type":"ContainerStarted","Data":"941fb8cee43a7a991ff1d5e6a684bd13eccb2db171e335d795643e685ec44a0c"} Jun 14 23:02:19.397103 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:19.397054 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" podStartSLOduration=3.087468177 podStartE2EDuration="5.397036604s" totalImagesPullingTime="994.443848ms" totalInitContainerRuntime="1.315124579s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:02:19.395992989 +0000 UTC m=+859.462375745" watchObservedRunningTime="2026-06-14 23:02:19.397036604 +0000 UTC m=+859.463419401" Jun 14 23:02:25.070632 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.070599 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b"] Jun 14 23:02:25.075221 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.075200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.077604 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.077583 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 14 23:02:25.083721 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.083664 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b"] Jun 14 23:02:25.137220 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.137186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.137387 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.137237 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b49b5375-dc7b-478b-a160-e2d41d7e1921-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.137387 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.137332 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bmnd\" (UniqueName: \"kubernetes.io/projected/b49b5375-dc7b-478b-a160-e2d41d7e1921-kube-api-access-4bmnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.137387 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.137364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.137387 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.137383 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.137577 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.137475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.198677 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.198641 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:25.198868 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.198706 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:25.211118 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.211086 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:25.238511 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.238477 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b49b5375-dc7b-478b-a160-e2d41d7e1921-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.238656 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.238572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bmnd\" (UniqueName: \"kubernetes.io/projected/b49b5375-dc7b-478b-a160-e2d41d7e1921-kube-api-access-4bmnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.238656 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.238637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.238807 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.238686 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.238807 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.238773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.238929 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.238862 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.239136 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.239114 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.239214 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.239141 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.239324 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.239308 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.240891 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.240866 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b49b5375-dc7b-478b-a160-e2d41d7e1921-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.241149 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.241131 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b49b5375-dc7b-478b-a160-e2d41d7e1921-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.245578 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.245556 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bmnd\" (UniqueName: \"kubernetes.io/projected/b49b5375-dc7b-478b-a160-e2d41d7e1921-kube-api-access-4bmnd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b\" (UID: \"b49b5375-dc7b-478b-a160-e2d41d7e1921\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.388379 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.388285 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:02:25.423607 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.423574 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg" Jun 14 23:02:25.528066 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:25.528042 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b"] Jun 14 23:02:25.529820 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:02:25.529797 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb49b5375_dc7b_478b_a160_e2d41d7e1921.slice/crio-700fa7b4a48c816a49fbe2c6744f9640291c3eaed76a94137ed9149acd995c37 WatchSource:0}: Error finding container 700fa7b4a48c816a49fbe2c6744f9640291c3eaed76a94137ed9149acd995c37: Status 404 returned error can't find the container with id 700fa7b4a48c816a49fbe2c6744f9640291c3eaed76a94137ed9149acd995c37 Jun 14 23:02:26.419091 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:26.419045 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" event={"ID":"b49b5375-dc7b-478b-a160-e2d41d7e1921","Type":"ContainerStarted","Data":"b244465eabf9674846fb0c80641f2519cd09409a05081ffac8a3cfcf008f0828"} Jun 14 23:02:26.419486 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:26.419120 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" event={"ID":"b49b5375-dc7b-478b-a160-e2d41d7e1921","Type":"ContainerStarted","Data":"700fa7b4a48c816a49fbe2c6744f9640291c3eaed76a94137ed9149acd995c37"} Jun 14 23:02:33.067992 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.067955 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq"] Jun 14 23:02:33.073406 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.073388 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.075659 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.075635 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 14 23:02:33.082558 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.082530 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq"] Jun 14 23:02:33.215441 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.215407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62591347-77cb-4566-b3eb-b44a6255f469-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.215626 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.215460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.215626 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.215512 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.215626 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.215564 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm6mv\" (UniqueName: \"kubernetes.io/projected/62591347-77cb-4566-b3eb-b44a6255f469-kube-api-access-gm6mv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.215626 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.215613 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.215794 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.215647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317096 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62591347-77cb-4566-b3eb-b44a6255f469-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317262 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317262 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317262 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm6mv\" (UniqueName: \"kubernetes.io/projected/62591347-77cb-4566-b3eb-b44a6255f469-kube-api-access-gm6mv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317262 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317430 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317269 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317681 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317658 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317836 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317694 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.317836 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.317721 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.319437 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.319369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62591347-77cb-4566-b3eb-b44a6255f469-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.319719 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.319701 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62591347-77cb-4566-b3eb-b44a6255f469-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.323939 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.323916 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm6mv\" (UniqueName: \"kubernetes.io/projected/62591347-77cb-4566-b3eb-b44a6255f469-kube-api-access-gm6mv\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-xkwkq\" (UID: \"62591347-77cb-4566-b3eb-b44a6255f469\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.384430 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.384395 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:33.524162 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:33.524133 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq"] Jun 14 23:02:33.526001 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:02:33.525977 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62591347_77cb_4566_b3eb_b44a6255f469.slice/crio-b385596f5c540f24f4d169d381c9d7ee9439132863b312b9e5ee85cc72836c9e WatchSource:0}: Error finding container b385596f5c540f24f4d169d381c9d7ee9439132863b312b9e5ee85cc72836c9e: Status 404 returned error can't find the container with id b385596f5c540f24f4d169d381c9d7ee9439132863b312b9e5ee85cc72836c9e Jun 14 23:02:34.464525 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:34.464481 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" event={"ID":"62591347-77cb-4566-b3eb-b44a6255f469","Type":"ContainerStarted","Data":"b23360dea01ae18fad4029bc5eb63614b2c554f07d8cbb6c677a9ed99ba87210"} Jun 14 23:02:34.465041 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:34.464538 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" event={"ID":"62591347-77cb-4566-b3eb-b44a6255f469","Type":"ContainerStarted","Data":"b385596f5c540f24f4d169d381c9d7ee9439132863b312b9e5ee85cc72836c9e"} Jun 14 23:02:42.509779 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:42.509723 2568 generic.go:356] "Generic (PLEG): container finished" podID="62591347-77cb-4566-b3eb-b44a6255f469" containerID="b23360dea01ae18fad4029bc5eb63614b2c554f07d8cbb6c677a9ed99ba87210" exitCode=0 Jun 14 23:02:42.510312 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:42.509809 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" event={"ID":"62591347-77cb-4566-b3eb-b44a6255f469","Type":"ContainerDied","Data":"b23360dea01ae18fad4029bc5eb63614b2c554f07d8cbb6c677a9ed99ba87210"} Jun 14 23:02:43.516574 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:43.516536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" event={"ID":"62591347-77cb-4566-b3eb-b44a6255f469","Type":"ContainerStarted","Data":"8f82fe18c296d2d76160060a3b689c0cda58d89db1d908c3cc6d9289fc9d52d0"} Jun 14 23:02:53.385343 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:53.385252 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:53.385343 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:53.385308 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:53.397848 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:53.397823 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:02:53.415793 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:53.415725 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" podStartSLOduration=11.752099548 podStartE2EDuration="20.415709466s" totalImagesPullingTime="180.597462ms" totalInitContainerRuntime="8.483012456s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:02:43.535239481 +0000 UTC m=+883.601622236" watchObservedRunningTime="2026-06-14 23:02:53.415709466 +0000 UTC m=+893.482092219" Jun 14 23:02:53.582449 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:02:53.582423 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-xkwkq" Jun 14 23:03:00.396276 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:00.396243 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:03:00.398426 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:00.398391 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:03:00.403696 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:00.403676 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:03:00.405604 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:00.405583 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:03:17.697345 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:17.697314 2568 generic.go:356] "Generic (PLEG): container finished" podID="b49b5375-dc7b-478b-a160-e2d41d7e1921" containerID="b244465eabf9674846fb0c80641f2519cd09409a05081ffac8a3cfcf008f0828" exitCode=0 Jun 14 23:03:17.697835 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:17.697347 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" event={"ID":"b49b5375-dc7b-478b-a160-e2d41d7e1921","Type":"ContainerDied","Data":"b244465eabf9674846fb0c80641f2519cd09409a05081ffac8a3cfcf008f0828"} Jun 14 23:03:18.704861 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:18.704827 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" event={"ID":"b49b5375-dc7b-478b-a160-e2d41d7e1921","Type":"ContainerStarted","Data":"09c5449db4ad4c905b483967f9a1c38f8d3604a0b9fc08f1c20fe5ee8c57e7ee"} Jun 14 23:03:18.723361 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:18.723311 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" podStartSLOduration=1.819212631 podStartE2EDuration="53.723295778s" totalImagesPullingTime="178.980974ms" totalInitContainerRuntime="51.725102173s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:02:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:03:18.721368585 +0000 UTC m=+918.787751339" watchObservedRunningTime="2026-06-14 23:03:18.723295778 +0000 UTC m=+918.789678531" Jun 14 23:03:25.388678 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:25.388638 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:03:25.389096 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:25.388717 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:03:25.401193 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:25.401164 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:03:25.757560 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:25.757530 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b" Jun 14 23:03:51.601323 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.601285 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c4b84496f-7x5fj"] Jun 14 23:03:51.605025 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.605006 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.612987 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.612958 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c4b84496f-7x5fj"] Jun 14 23:03:51.655507 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.655478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dwbf\" (UniqueName: \"kubernetes.io/projected/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-kube-api-access-7dwbf\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.655656 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.655519 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-tls-cert\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.655656 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.655586 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-oidc-ca\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.756262 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.756232 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-oidc-ca\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.756424 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.756316 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dwbf\" (UniqueName: \"kubernetes.io/projected/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-kube-api-access-7dwbf\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.756424 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.756360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-tls-cert\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.757050 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.757029 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-oidc-ca\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.758786 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.758769 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-tls-cert\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.763636 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.763617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dwbf\" (UniqueName: \"kubernetes.io/projected/d3adeaf1-aa14-42da-8ddd-f4d40e91908d-kube-api-access-7dwbf\") pod \"authorino-6c4b84496f-7x5fj\" (UID: \"d3adeaf1-aa14-42da-8ddd-f4d40e91908d\") " pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:51.915179 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:51.915100 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c4b84496f-7x5fj" Jun 14 23:03:52.060858 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:52.060718 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c4b84496f-7x5fj"] Jun 14 23:03:52.063378 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:03:52.063349 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd3adeaf1_aa14_42da_8ddd_f4d40e91908d.slice/crio-38e601780dc1b6c4a564e94039532951863b1db1e052352eb00d869d988180a4 WatchSource:0}: Error finding container 38e601780dc1b6c4a564e94039532951863b1db1e052352eb00d869d988180a4: Status 404 returned error can't find the container with id 38e601780dc1b6c4a564e94039532951863b1db1e052352eb00d869d988180a4 Jun 14 23:03:52.064912 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:52.064891 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 14 23:03:52.908520 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:52.908428 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c4b84496f-7x5fj" event={"ID":"d3adeaf1-aa14-42da-8ddd-f4d40e91908d","Type":"ContainerStarted","Data":"23e6ef6d27f822c15c18d0a79ac718a781b0fdd2fc6dbd4c0d365cea410fc04d"} Jun 14 23:03:52.909075 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:52.909048 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c4b84496f-7x5fj" event={"ID":"d3adeaf1-aa14-42da-8ddd-f4d40e91908d","Type":"ContainerStarted","Data":"38e601780dc1b6c4a564e94039532951863b1db1e052352eb00d869d988180a4"} Jun 14 23:03:52.921808 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:52.921730 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c4b84496f-7x5fj" podStartSLOduration=1.5213291519999999 podStartE2EDuration="1.921709749s" totalImagesPullingTime="400.380597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-14 23:03:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:03:52.920805976 +0000 UTC m=+952.987188754" watchObservedRunningTime="2026-06-14 23:03:52.921709749 +0000 UTC m=+952.988092503" Jun 14 23:03:52.949179 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:52.949143 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f68c9b84-c2kpq"] Jun 14 23:03:52.949632 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:52.949599 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" podUID="35e2c815-474e-4e5a-9b1e-7592c5528c39" containerName="authorino" containerID="cri-o://e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5" gracePeriod=30 Jun 14 23:03:53.240760 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.240709 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:03:53.375930 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.375898 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35e2c815-474e-4e5a-9b1e-7592c5528c39-tls-cert\") pod \"35e2c815-474e-4e5a-9b1e-7592c5528c39\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " Jun 14 23:03:53.376135 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.375982 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9dnj\" (UniqueName: \"kubernetes.io/projected/35e2c815-474e-4e5a-9b1e-7592c5528c39-kube-api-access-z9dnj\") pod \"35e2c815-474e-4e5a-9b1e-7592c5528c39\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " Jun 14 23:03:53.376135 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.376055 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/35e2c815-474e-4e5a-9b1e-7592c5528c39-oidc-ca\") pod \"35e2c815-474e-4e5a-9b1e-7592c5528c39\" (UID: \"35e2c815-474e-4e5a-9b1e-7592c5528c39\") " Jun 14 23:03:53.378121 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.378087 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35e2c815-474e-4e5a-9b1e-7592c5528c39-kube-api-access-z9dnj" (OuterVolumeSpecName: "kube-api-access-z9dnj") pod "35e2c815-474e-4e5a-9b1e-7592c5528c39" (UID: "35e2c815-474e-4e5a-9b1e-7592c5528c39"). InnerVolumeSpecName "kube-api-access-z9dnj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:03:53.381732 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.381702 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35e2c815-474e-4e5a-9b1e-7592c5528c39-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "35e2c815-474e-4e5a-9b1e-7592c5528c39" (UID: "35e2c815-474e-4e5a-9b1e-7592c5528c39"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 14 23:03:53.388379 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.388353 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/35e2c815-474e-4e5a-9b1e-7592c5528c39-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "35e2c815-474e-4e5a-9b1e-7592c5528c39" (UID: "35e2c815-474e-4e5a-9b1e-7592c5528c39"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 23:03:53.477644 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.477544 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9dnj\" (UniqueName: \"kubernetes.io/projected/35e2c815-474e-4e5a-9b1e-7592c5528c39-kube-api-access-z9dnj\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:03:53.477644 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.477578 2568 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/35e2c815-474e-4e5a-9b1e-7592c5528c39-oidc-ca\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:03:53.477644 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.477588 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/35e2c815-474e-4e5a-9b1e-7592c5528c39-tls-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:03:53.915985 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.915951 2568 generic.go:356] "Generic (PLEG): container finished" podID="35e2c815-474e-4e5a-9b1e-7592c5528c39" containerID="e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5" exitCode=0 Jun 14 23:03:53.916449 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.916002 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" Jun 14 23:03:53.916449 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.916031 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" event={"ID":"35e2c815-474e-4e5a-9b1e-7592c5528c39","Type":"ContainerDied","Data":"e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5"} Jun 14 23:03:53.916449 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.916075 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f68c9b84-c2kpq" event={"ID":"35e2c815-474e-4e5a-9b1e-7592c5528c39","Type":"ContainerDied","Data":"818be0dc0dfdb2edc87fb5eaa00d985f6f508932fe1c8f50b313752e8360c98d"} Jun 14 23:03:53.916449 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.916095 2568 scope.go:117] "RemoveContainer" containerID="e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5" Jun 14 23:03:53.926271 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.926257 2568 scope.go:117] "RemoveContainer" containerID="e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5" Jun 14 23:03:53.926516 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:03:53.926498 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5\": container with ID starting with e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5 not found: ID does not exist" containerID="e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5" Jun 14 23:03:53.926558 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.926525 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5"} err="failed to get container status \"e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5\": rpc error: code = NotFound desc = could not find container \"e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5\": container with ID starting with e9d69a577ff633fda5d50b62b6a25b2706181486b2e5ed3632786b6f1b6eeef5 not found: ID does not exist" Jun 14 23:03:53.937090 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.937069 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f68c9b84-c2kpq"] Jun 14 23:03:53.940519 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:53.940498 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f68c9b84-c2kpq"] Jun 14 23:03:54.364688 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:03:54.364655 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e2c815-474e-4e5a-9b1e-7592c5528c39" path="/var/lib/kubelet/pods/35e2c815-474e-4e5a-9b1e-7592c5528c39/volumes" Jun 14 23:05:18.919974 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:18.919935 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c87d57569-crjlr"] Jun 14 23:05:18.920487 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:18.920149 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6c87d57569-crjlr" podUID="2e2f6bc9-d510-4eec-b017-41e4cbc222bc" containerName="manager" containerID="cri-o://b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482" gracePeriod=30 Jun 14 23:05:19.181342 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.181316 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:05:19.330028 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.329994 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5kw4\" (UniqueName: \"kubernetes.io/projected/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-kube-api-access-x5kw4\") pod \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\" (UID: \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\") " Jun 14 23:05:19.330173 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.330076 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-webhook-cert\") pod \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\" (UID: \"2e2f6bc9-d510-4eec-b017-41e4cbc222bc\") " Jun 14 23:05:19.332119 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.332089 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-kube-api-access-x5kw4" (OuterVolumeSpecName: "kube-api-access-x5kw4") pod "2e2f6bc9-d510-4eec-b017-41e4cbc222bc" (UID: "2e2f6bc9-d510-4eec-b017-41e4cbc222bc"). InnerVolumeSpecName "kube-api-access-x5kw4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 14 23:05:19.332227 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.332099 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2e2f6bc9-d510-4eec-b017-41e4cbc222bc" (UID: "2e2f6bc9-d510-4eec-b017-41e4cbc222bc"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 14 23:05:19.427552 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.427519 2568 generic.go:356] "Generic (PLEG): container finished" podID="2e2f6bc9-d510-4eec-b017-41e4cbc222bc" containerID="b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482" exitCode=0 Jun 14 23:05:19.427703 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.427566 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c87d57569-crjlr" Jun 14 23:05:19.427703 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.427597 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c87d57569-crjlr" event={"ID":"2e2f6bc9-d510-4eec-b017-41e4cbc222bc","Type":"ContainerDied","Data":"b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482"} Jun 14 23:05:19.427703 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.427654 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c87d57569-crjlr" event={"ID":"2e2f6bc9-d510-4eec-b017-41e4cbc222bc","Type":"ContainerDied","Data":"48d84cb4769d3bde85ae65cbb03ee1fc5d1b795ef84bc6fd27c84dbec6de0b4b"} Jun 14 23:05:19.427703 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.427676 2568 scope.go:117] "RemoveContainer" containerID="b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482" Jun 14 23:05:19.431131 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.431103 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5kw4\" (UniqueName: \"kubernetes.io/projected/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-kube-api-access-x5kw4\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:05:19.431256 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.431136 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2e2f6bc9-d510-4eec-b017-41e4cbc222bc-webhook-cert\") on node \"ip-10-0-129-69.ec2.internal\" DevicePath \"\"" Jun 14 23:05:19.437486 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.437470 2568 scope.go:117] "RemoveContainer" containerID="b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482" Jun 14 23:05:19.437723 ip-10-0-129-69 kubenswrapper[2568]: E0614 23:05:19.437704 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482\": container with ID starting with b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482 not found: ID does not exist" containerID="b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482" Jun 14 23:05:19.437811 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.437729 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482"} err="failed to get container status \"b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482\": rpc error: code = NotFound desc = could not find container \"b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482\": container with ID starting with b275fe711aa768d8232cb2af62ea9bd920a1ece3480e13652f05178edb31c482 not found: ID does not exist" Jun 14 23:05:19.448018 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.447998 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c87d57569-crjlr"] Jun 14 23:05:19.450226 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:19.450206 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c87d57569-crjlr"] Jun 14 23:05:20.364354 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:05:20.364323 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2f6bc9-d510-4eec-b017-41e4cbc222bc" path="/var/lib/kubelet/pods/2e2f6bc9-d510-4eec-b017-41e4cbc222bc/volumes" Jun 14 23:08:00.437674 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:08:00.437644 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:08:00.441459 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:08:00.441437 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:08:00.445072 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:08:00.445042 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:08:00.448894 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:08:00.448878 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:13:00.475806 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:13:00.475774 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:13:00.481180 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:13:00.481156 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:13:00.482821 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:13:00.482798 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:13:00.487996 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:13:00.487975 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:18:00.512165 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:18:00.512132 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:18:00.518106 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:18:00.518082 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:18:00.519187 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:18:00.519167 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:18:00.524918 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:18:00.524900 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:23:00.550475 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:23:00.550444 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:23:00.557485 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:23:00.557463 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:23:00.557897 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:23:00.557872 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:23:00.564589 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:23:00.564571 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wb65p_8d089068-2e48-485b-98a3-045a0f648de5/ovn-acl-logging/0.log" Jun 14 23:26:23.490498 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:23.490463 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c4b84496f-7x5fj_d3adeaf1-aa14-42da-8ddd-f4d40e91908d/authorino/0.log" Jun 14 23:26:28.237455 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:28.237417 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-585bd99f8d-rk6wq_8c8f0d43-c99e-4972-9307-e179cfa92d79/maas-api/0.log" Jun 14 23:26:28.902624 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:28.902600 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-jqc8b_382da98a-20e8-40fe-b00a-d60601f391bc/copy-manifests/0.log" Jun 14 23:26:28.908701 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:28.908675 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-jqc8b_382da98a-20e8-40fe-b00a-d60601f391bc/manager/0.log" Jun 14 23:26:29.138377 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:29.138346 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wgcvf_d361bdf6-2a0d-41ab-ac42-cf172dc9616c/postgres/0.log" Jun 14 23:26:30.344253 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:30.344217 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c4b84496f-7x5fj_d3adeaf1-aa14-42da-8ddd-f4d40e91908d/authorino/0.log" Jun 14 23:26:30.667335 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:30.667256 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lx6h9_d2e91679-7412-4822-a369-3f09eefdacd8/kuadrant-console-plugin/0.log" Jun 14 23:26:31.669058 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:31.669029 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-252d8_f8f43de9-2fbe-48fd-a109-c10f4fdc185d/kube-auth-proxy/0.log" Jun 14 23:26:31.999344 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:31.999305 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wrmgf_a9b8c865-9c0c-46dc-a828-8f8cf1396717/payload-pre-processing/0.log" Jun 14 23:26:32.110260 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:32.110223 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pw27m_8aed2e83-9e89-469a-9c50-0d01cc04b22a/payload-processing/0.log" Jun 14 23:26:32.546622 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:32.546589 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-kwhfk_f64e5301-8838-4645-a637-2e02426b7443/storage-initializer/0.log" Jun 14 23:26:32.767980 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:32.767951 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg_fe0e1f89-918b-4084-9c71-3d38a75ba810/storage-initializer/0.log" Jun 14 23:26:32.775130 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:32.775105 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-49dkg_fe0e1f89-918b-4084-9c71-3d38a75ba810/main/0.log" Jun 14 23:26:32.880187 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:32.880104 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b_b49b5375-dc7b-478b-a160-e2d41d7e1921/storage-initializer/0.log" Jun 14 23:26:32.887624 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:32.887590 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cbtk8b_b49b5375-dc7b-478b-a160-e2d41d7e1921/main/0.log" Jun 14 23:26:33.104067 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:33.104038 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-xkwkq_62591347-77cb-4566-b3eb-b44a6255f469/storage-initializer/0.log" Jun 14 23:26:33.111433 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:33.111409 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-xkwkq_62591347-77cb-4566-b3eb-b44a6255f469/main/0.log" Jun 14 23:26:39.687120 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:39.687087 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pjvgp_ec01c46e-e265-407f-bce2-630e457dd40f/global-pull-secret-syncer/0.log" Jun 14 23:26:39.830405 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:39.830372 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vzqdb_af3293c7-c2f1-4760-bca0-bb88ac81481a/konnectivity-agent/0.log" Jun 14 23:26:39.873317 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:39.873285 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-69.ec2.internal_e6cc1eeeda5c676493db83fa5936c2f7/haproxy/0.log" Jun 14 23:26:45.011098 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:45.011057 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6c4b84496f-7x5fj_d3adeaf1-aa14-42da-8ddd-f4d40e91908d/authorino/0.log" Jun 14 23:26:45.092515 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:45.092485 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-lx6h9_d2e91679-7412-4822-a369-3f09eefdacd8/kuadrant-console-plugin/0.log" Jun 14 23:26:46.866810 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:46.866778 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa4ef45-29d4-4929-93eb-9803cf2a9766/alertmanager/0.log" Jun 14 23:26:46.887814 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:46.887786 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa4ef45-29d4-4929-93eb-9803cf2a9766/config-reloader/0.log" Jun 14 23:26:46.908110 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:46.908083 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa4ef45-29d4-4929-93eb-9803cf2a9766/kube-rbac-proxy-web/0.log" Jun 14 23:26:46.928935 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:46.928914 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa4ef45-29d4-4929-93eb-9803cf2a9766/kube-rbac-proxy/0.log" Jun 14 23:26:46.947346 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:46.947323 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa4ef45-29d4-4929-93eb-9803cf2a9766/kube-rbac-proxy-metric/0.log" Jun 14 23:26:46.966045 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:46.966024 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa4ef45-29d4-4929-93eb-9803cf2a9766/prom-label-proxy/0.log" Jun 14 23:26:46.987595 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:46.987574 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa4ef45-29d4-4929-93eb-9803cf2a9766/init-config-reloader/0.log" Jun 14 23:26:47.034789 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.034761 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-dcmcc_d35f990e-9e37-4e40-9395-aeaa25f1ce8b/cluster-monitoring-operator/0.log" Jun 14 23:26:47.063663 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.063641 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4crc2_2a690e2e-7238-4d2f-98e7-5f6981b6df0e/kube-state-metrics/0.log" Jun 14 23:26:47.079163 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.079138 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4crc2_2a690e2e-7238-4d2f-98e7-5f6981b6df0e/kube-rbac-proxy-main/0.log" Jun 14 23:26:47.099547 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.099482 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-4crc2_2a690e2e-7238-4d2f-98e7-5f6981b6df0e/kube-rbac-proxy-self/0.log" Jun 14 23:26:47.167268 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.167191 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-hf2dk_ea4e9010-ca54-4865-8950-309ad61f3352/monitoring-plugin/0.log" Jun 14 23:26:47.380374 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.380018 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sl6vk_91aacdba-6522-40a4-813a-9c3a9ef5b62e/node-exporter/0.log" Jun 14 23:26:47.413647 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.413621 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sl6vk_91aacdba-6522-40a4-813a-9c3a9ef5b62e/kube-rbac-proxy/0.log" Jun 14 23:26:47.454358 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.454336 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sl6vk_91aacdba-6522-40a4-813a-9c3a9ef5b62e/init-textfile/0.log" Jun 14 23:26:47.814422 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.814332 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-x725d_ec1d5d36-99b0-4563-be9c-ea26c279cac4/prometheus-operator/0.log" Jun 14 23:26:47.832106 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.832084 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-x725d_ec1d5d36-99b0-4563-be9c-ea26c279cac4/kube-rbac-proxy/0.log" Jun 14 23:26:47.970662 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.970634 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd89d576-7m542_7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4/thanos-query/0.log" Jun 14 23:26:47.989365 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:47.989341 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd89d576-7m542_7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4/kube-rbac-proxy-web/0.log" Jun 14 23:26:48.008354 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:48.008332 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd89d576-7m542_7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4/kube-rbac-proxy/0.log" Jun 14 23:26:48.032662 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:48.032640 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd89d576-7m542_7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4/prom-label-proxy/0.log" Jun 14 23:26:48.051910 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:48.051887 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd89d576-7m542_7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4/kube-rbac-proxy-rules/0.log" Jun 14 23:26:48.071499 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:48.071440 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-59bd89d576-7m542_7dd7ee4c-8a25-4f49-8d9d-fe12400aaad4/kube-rbac-proxy-metrics/0.log" Jun 14 23:26:49.410321 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:49.410291 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-st7dt_cf45feee-c6a8-4fc1-bf88-032bae2ced72/networking-console-plugin/0.log" Jun 14 23:26:50.017861 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.017831 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/2.log" Jun 14 23:26:50.025001 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.024975 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-l6qgq_89981dda-2420-42ba-9c6b-a2ca61f5b386/console-operator/3.log" Jun 14 23:26:50.528680 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.528648 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86db6cd958-ks5lg_56af23e6-7cdb-45fa-8208-4bb4c6bebd07/console/0.log" Jun 14 23:26:50.578688 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.578660 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-wxnc8_7e65d275-9791-4cad-b7b4-c5e35d418b4b/download-server/0.log" Jun 14 23:26:50.985596 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.985558 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm"] Jun 14 23:26:50.986156 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.986138 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2f6bc9-d510-4eec-b017-41e4cbc222bc" containerName="manager" Jun 14 23:26:50.986215 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.986159 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2f6bc9-d510-4eec-b017-41e4cbc222bc" containerName="manager" Jun 14 23:26:50.986215 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.986184 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e2c815-474e-4e5a-9b1e-7592c5528c39" containerName="authorino" Jun 14 23:26:50.986215 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.986189 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e2c815-474e-4e5a-9b1e-7592c5528c39" containerName="authorino" Jun 14 23:26:50.986305 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.986263 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2f6bc9-d510-4eec-b017-41e4cbc222bc" containerName="manager" Jun 14 23:26:50.986305 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.986274 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e2c815-474e-4e5a-9b1e-7592c5528c39" containerName="authorino" Jun 14 23:26:50.989670 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.989654 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:50.991983 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.991936 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxx4\"/\"openshift-service-ca.crt\"" Jun 14 23:26:50.992904 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.992887 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jpxx4\"/\"kube-root-ca.crt\"" Jun 14 23:26:50.993017 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.992886 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jpxx4\"/\"default-dockercfg-wmz5r\"" Jun 14 23:26:50.998196 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:50.998175 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm"] Jun 14 23:26:51.113388 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.113357 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-podres\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.113552 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.113480 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-sys\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.113552 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.113523 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-lib-modules\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.113627 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.113551 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-proc\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.113627 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.113574 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfdx4\" (UniqueName: \"kubernetes.io/projected/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-kube-api-access-dfdx4\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.214765 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.214708 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-podres\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.214954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.214838 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-sys\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.214954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.214864 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-lib-modules\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.214954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.214882 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-proc\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.214954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.214904 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-podres\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.214954 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.214907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfdx4\" (UniqueName: \"kubernetes.io/projected/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-kube-api-access-dfdx4\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.215182 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.214976 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-proc\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.215182 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.215008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-lib-modules\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.215182 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.215018 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-sys\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.222272 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.222251 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfdx4\" (UniqueName: \"kubernetes.io/projected/dcf4eb42-3d0f-4905-b9c0-b830474f69f2-kube-api-access-dfdx4\") pod \"perf-node-gather-daemonset-4hqgm\" (UID: \"dcf4eb42-3d0f-4905-b9c0-b830474f69f2\") " pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.300158 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.300087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.434505 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.434477 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm"] Jun 14 23:26:51.436124 ip-10-0-129-69 kubenswrapper[2568]: W0614 23:26:51.436096 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddcf4eb42_3d0f_4905_b9c0_b830474f69f2.slice/crio-540763c1f0016c2d73d581f4b56115122a92d389cb7f2a9a5d6e4e2c065ee9b2 WatchSource:0}: Error finding container 540763c1f0016c2d73d581f4b56115122a92d389cb7f2a9a5d6e4e2c065ee9b2: Status 404 returned error can't find the container with id 540763c1f0016c2d73d581f4b56115122a92d389cb7f2a9a5d6e4e2c065ee9b2 Jun 14 23:26:51.535277 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.535249 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" event={"ID":"dcf4eb42-3d0f-4905-b9c0-b830474f69f2","Type":"ContainerStarted","Data":"df343ee1d86edfd233f617ede84543034bd7352008099c5321f471455e11cc54"} Jun 14 23:26:51.535693 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.535307 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" event={"ID":"dcf4eb42-3d0f-4905-b9c0-b830474f69f2","Type":"ContainerStarted","Data":"540763c1f0016c2d73d581f4b56115122a92d389cb7f2a9a5d6e4e2c065ee9b2"} Jun 14 23:26:51.535693 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.535449 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:51.551597 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:51.551519 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" podStartSLOduration=1.5515075120000001 podStartE2EDuration="1.551507512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-14 23:26:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-14 23:26:51.548843972 +0000 UTC m=+2331.615226738" watchObservedRunningTime="2026-06-14 23:26:51.551507512 +0000 UTC m=+2331.617890265" Jun 14 23:26:52.393649 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:52.393616 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-55m9x_21919e62-63b8-4c0b-af0c-7465e15fc018/dns/0.log" Jun 14 23:26:52.415502 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:52.415472 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-55m9x_21919e62-63b8-4c0b-af0c-7465e15fc018/kube-rbac-proxy/0.log" Jun 14 23:26:52.531612 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:52.531581 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4nh86_e79e59cc-8c51-48b5-83cb-d0636f606a00/dns-node-resolver/0.log" Jun 14 23:26:53.147139 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:53.147109 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pwsbh_4421799d-5cac-4b15-b643-b2e6f184a1b7/node-ca/0.log" Jun 14 23:26:54.153261 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:54.153228 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-252d8_f8f43de9-2fbe-48fd-a109-c10f4fdc185d/kube-auth-proxy/0.log" Jun 14 23:26:54.287031 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:54.287001 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wrmgf_a9b8c865-9c0c-46dc-a828-8f8cf1396717/payload-pre-processing/0.log" Jun 14 23:26:54.392853 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:54.392801 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pw27m_8aed2e83-9e89-469a-9c50-0d01cc04b22a/payload-processing/0.log" Jun 14 23:26:55.057538 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:55.057507 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zlrj5_c5cda7cf-a96a-4dd5-82ee-2339616c1b9a/serve-healthcheck-canary/0.log" Jun 14 23:26:55.536289 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:55.536259 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-4jfph_21d8e7ab-6d4f-4410-8b6c-573ae00c5899/insights-operator/0.log" Jun 14 23:26:55.538277 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:55.538255 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-4jfph_21d8e7ab-6d4f-4410-8b6c-573ae00c5899/insights-operator/1.log" Jun 14 23:26:55.556716 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:55.556694 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kchb7_54da4925-3403-4d5d-a1e7-9b844ed49cdb/kube-rbac-proxy/0.log" Jun 14 23:26:55.574876 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:55.574852 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kchb7_54da4925-3403-4d5d-a1e7-9b844ed49cdb/exporter/0.log" Jun 14 23:26:55.598289 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:55.598263 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kchb7_54da4925-3403-4d5d-a1e7-9b844ed49cdb/extractor/0.log" Jun 14 23:26:57.549994 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:57.549967 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jpxx4/perf-node-gather-daemonset-4hqgm" Jun 14 23:26:58.041278 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:58.041249 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-585bd99f8d-rk6wq_8c8f0d43-c99e-4972-9307-e179cfa92d79/maas-api/0.log" Jun 14 23:26:58.290555 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:58.290527 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-jqc8b_382da98a-20e8-40fe-b00a-d60601f391bc/manager/0.log" Jun 14 23:26:58.309302 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:58.309231 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cf75689df-jqc8b_382da98a-20e8-40fe-b00a-d60601f391bc/copy-manifests/0.log" Jun 14 23:26:58.437867 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:26:58.437831 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-wgcvf_d361bdf6-2a0d-41ab-ac42-cf172dc9616c/postgres/0.log" Jun 14 23:27:00.045989 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:00.045950 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59bb6ccd6d-lbt7l_36f5c55e-5f7c-48d0-b4df-949b883aa88c/manager/0.log" Jun 14 23:27:04.754312 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:04.754282 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-252d8_f8f43de9-2fbe-48fd-a109-c10f4fdc185d/kube-auth-proxy/0.log" Jun 14 23:27:04.863450 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:04.863414 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wrmgf_a9b8c865-9c0c-46dc-a828-8f8cf1396717/payload-pre-processing/0.log" Jun 14 23:27:04.943277 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:04.943244 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pw27m_8aed2e83-9e89-469a-9c50-0d01cc04b22a/payload-processing/0.log" Jun 14 23:27:05.380790 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:05.380727 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-6vhxc_e42154f1-89ba-4d9f-8b95-5c7b09038e20/migrator/0.log" Jun 14 23:27:05.465568 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:05.465535 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-6vhxc_e42154f1-89ba-4d9f-8b95-5c7b09038e20/graceful-termination/0.log" Jun 14 23:27:06.134799 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:06.134768 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-252d8_f8f43de9-2fbe-48fd-a109-c10f4fdc185d/kube-auth-proxy/0.log" Jun 14 23:27:06.245715 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:06.245683 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wrmgf_a9b8c865-9c0c-46dc-a828-8f8cf1396717/payload-pre-processing/0.log" Jun 14 23:27:06.329454 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:06.329408 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pw27m_8aed2e83-9e89-469a-9c50-0d01cc04b22a/payload-processing/0.log" Jun 14 23:27:06.971878 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:06.971716 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7f6gp_1a75dc5e-d60a-432b-a1a9-4639f77052c6/kube-multus/0.log" Jun 14 23:27:07.178710 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.178681 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbkbb_f1b464e1-b467-43d3-8ff1-17975126be5a/kube-multus-additional-cni-plugins/0.log" Jun 14 23:27:07.199085 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.199059 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbkbb_f1b464e1-b467-43d3-8ff1-17975126be5a/egress-router-binary-copy/0.log" Jun 14 23:27:07.217869 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.217848 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbkbb_f1b464e1-b467-43d3-8ff1-17975126be5a/cni-plugins/0.log" Jun 14 23:27:07.236318 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.236246 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbkbb_f1b464e1-b467-43d3-8ff1-17975126be5a/bond-cni-plugin/0.log" Jun 14 23:27:07.254977 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.254951 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbkbb_f1b464e1-b467-43d3-8ff1-17975126be5a/routeoverride-cni/0.log" Jun 14 23:27:07.274821 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.274788 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbkbb_f1b464e1-b467-43d3-8ff1-17975126be5a/whereabouts-cni-bincopy/0.log" Jun 14 23:27:07.295461 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.295437 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fbkbb_f1b464e1-b467-43d3-8ff1-17975126be5a/whereabouts-cni/0.log" Jun 14 23:27:07.575120 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.575045 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pwqsb_af9ceced-b4ae-40c1-b7c0-77966f7a505d/network-metrics-daemon/0.log" Jun 14 23:27:07.592790 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.592731 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-pwqsb_af9ceced-b4ae-40c1-b7c0-77966f7a505d/kube-rbac-proxy/0.log" Jun 14 23:27:07.966570 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:07.966540 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f989997cb-252d8_f8f43de9-2fbe-48fd-a109-c10f4fdc185d/kube-auth-proxy/0.log" Jun 14 23:27:08.073709 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:08.073677 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-wrmgf_a9b8c865-9c0c-46dc-a828-8f8cf1396717/payload-pre-processing/0.log" Jun 14 23:27:08.154925 ip-10-0-129-69 kubenswrapper[2568]: I0614 23:27:08.154892 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-pw27m_8aed2e83-9e89-469a-9c50-0d01cc04b22a/payload-processing/0.log"