Jun 15 01:36:06.684687 ip-10-0-135-94 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 01:36:06.684698 ip-10-0-135-94 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 01:36:06.684705 ip-10-0-135-94 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 01:36:06.684908 ip-10-0-135-94 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 01:36:17.992124 ip-10-0-135-94 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 01:36:17.992143 ip-10-0-135-94 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 22344c99e53f401b856ce6b4f49a2ce8 -- Jun 15 01:38:44.055916 ip-10-0-135-94 systemd[1]: Starting Kubernetes Kubelet... Jun 15 01:38:44.372163 ip-10-0-135-94 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:44.372163 ip-10-0-135-94 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 01:38:44.372163 ip-10-0-135-94 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:44.372163 ip-10-0-135-94 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 01:38:44.372163 ip-10-0-135-94 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:38:44.373598 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.373526 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 01:38:44.377664 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377650 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:44.377664 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377664 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377668 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377673 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377677 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377680 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377683 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377686 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377689 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377692 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377695 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377706 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377708 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377711 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377714 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377716 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377719 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377721 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377724 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377727 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:44.377732 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377730 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377732 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377735 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377738 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377746 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377749 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377752 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377754 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377757 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377760 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377762 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377765 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377769 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377773 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377775 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377778 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377780 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377783 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377785 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:44.378198 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377788 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377790 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377793 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377795 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377798 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377801 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377803 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377806 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377808 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377811 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377813 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377815 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377818 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377820 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377822 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377826 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377829 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377831 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377833 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377836 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:44.378704 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377838 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377841 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377843 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377846 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377848 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377850 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377853 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377856 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377858 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377860 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377863 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377865 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377869 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377872 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377874 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377876 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377879 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377882 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377885 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377887 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:44.379201 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377890 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377892 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377895 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377898 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377901 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377903 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377908 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377912 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377914 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377917 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377920 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377923 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377926 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377928 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377930 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377933 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377935 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377938 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377940 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:44.379730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.377943 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378614 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378621 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378624 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378628 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378631 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378647 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378650 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378653 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378656 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378658 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378661 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378664 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378667 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378670 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378672 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378676 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378678 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378681 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378683 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:44.380190 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378686 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378689 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378691 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378694 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378696 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378699 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378701 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378704 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378706 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378709 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378712 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378715 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378717 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378720 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378722 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378725 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378727 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378730 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378732 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378735 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:44.380811 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378739 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378743 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378746 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378749 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378753 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378757 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378760 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378763 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378766 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378769 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378772 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378774 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378778 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378781 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378783 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378786 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378788 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378791 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378794 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378796 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:44.381300 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378799 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378802 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378804 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378807 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378809 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378812 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378815 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378817 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378819 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378822 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378824 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378827 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378830 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378832 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378835 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378837 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378840 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378842 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378845 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378848 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:44.381807 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378850 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378852 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378856 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378859 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378862 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378865 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378868 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378871 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378875 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378877 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378879 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378882 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378885 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378888 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378890 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378893 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378896 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378898 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378901 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:44.382295 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.378903 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379227 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379231 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379234 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379237 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379240 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379243 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379245 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379248 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379252 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379256 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379259 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379262 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379264 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379267 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379270 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379272 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379274 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379277 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:44.382786 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379279 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379282 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379286 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379289 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379291 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379294 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379297 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379299 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379302 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379305 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379307 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379310 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379312 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379315 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379317 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379320 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379322 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379325 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379328 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379330 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:44.383241 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379333 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379336 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379338 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379341 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379343 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379346 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379350 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379352 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379354 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379357 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379359 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379362 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379364 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379367 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379370 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379372 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379374 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379378 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379380 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379383 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:44.383749 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379385 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379388 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379391 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379393 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379395 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379398 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379400 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379403 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379405 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379408 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379411 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379414 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379416 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379419 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379424 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379427 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379430 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379433 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379436 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:44.384236 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379439 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379442 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379444 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379446 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379449 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379451 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379454 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379456 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379459 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379462 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379464 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379467 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379469 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379472 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379474 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379477 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379479 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379481 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379484 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379486 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:44.384729 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379489 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.379491 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379565 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379575 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379584 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379590 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379596 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379600 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379604 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379608 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379611 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379614 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379618 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379621 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379624 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379627 2574 flags.go:64] FLAG: --cgroup-root="" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379630 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379633 2574 flags.go:64] FLAG: --client-ca-file="" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379648 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379650 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379654 2574 flags.go:64] FLAG: --cluster-domain="" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379657 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379662 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 01:38:44.385217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379665 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379668 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379672 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379675 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379678 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379681 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379684 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379687 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379690 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379693 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379696 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379700 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379706 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379709 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379712 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379715 2574 flags.go:64] FLAG: --enable-server="true" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379717 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379721 2574 flags.go:64] FLAG: --event-burst="100" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379724 2574 flags.go:64] FLAG: --event-qps="50" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379727 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379730 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379733 2574 flags.go:64] FLAG: --eviction-hard="" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379738 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379741 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379744 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 01:38:44.385769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379747 2574 flags.go:64] FLAG: --eviction-soft="" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379750 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379753 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379756 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379759 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379761 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379766 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379769 2574 flags.go:64] FLAG: --feature-gates="" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379772 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379775 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379778 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379781 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379784 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379787 2574 flags.go:64] FLAG: --help="false" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379790 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379793 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379796 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379798 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379802 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379806 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379809 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379812 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379814 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 01:38:44.386680 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379817 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379820 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379823 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379826 2574 flags.go:64] FLAG: --kube-reserved="" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379828 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379831 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379834 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379837 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379840 2574 flags.go:64] FLAG: --lock-file="" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379843 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379845 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379848 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379853 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379856 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379859 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379865 2574 flags.go:64] FLAG: --logging-format="text" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379868 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379871 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379874 2574 flags.go:64] FLAG: --manifest-url="" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379877 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379881 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379884 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379888 2574 flags.go:64] FLAG: --max-pods="110" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379891 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379894 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 01:38:44.387549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379897 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379900 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379903 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379907 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379910 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379916 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379919 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379922 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379925 2574 flags.go:64] FLAG: --pod-cidr="" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379928 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379933 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379936 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379938 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379941 2574 flags.go:64] FLAG: --port="10250" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379944 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379947 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0010e2764b3925451" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379951 2574 flags.go:64] FLAG: --qos-reserved="" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379953 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379956 2574 flags.go:64] FLAG: --register-node="true" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379960 2574 flags.go:64] FLAG: --register-with-taints="" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379963 2574 flags.go:64] FLAG: --registry-burst="10" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379966 2574 flags.go:64] FLAG: --registry-qps="5" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379970 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379973 2574 flags.go:64] FLAG: --reserved-memory="" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379977 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 01:38:44.388559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379980 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379983 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379986 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379989 2574 flags.go:64] FLAG: --runonce="false" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379991 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379995 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.379998 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380001 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380003 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380006 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380009 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380013 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380016 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380019 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380021 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380024 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380027 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380030 2574 flags.go:64] FLAG: --system-cgroups="" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380032 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380037 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380040 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380043 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380046 2574 flags.go:64] FLAG: --tls-min-version="" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380049 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380052 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 01:38:44.389662 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380055 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380058 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380060 2574 flags.go:64] FLAG: --v="2" Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380064 2574 flags.go:64] FLAG: --version="false" Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380070 2574 flags.go:64] FLAG: --vmodule="" Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380073 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380076 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380181 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380184 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380187 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380191 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380193 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380196 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380199 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380202 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380205 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380207 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380209 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380213 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380216 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:44.390449 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380218 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380221 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380223 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380226 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380228 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380231 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380233 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380236 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380239 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380241 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380244 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380247 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380250 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380252 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380255 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380257 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380261 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380263 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380266 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380268 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380270 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:44.391048 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380273 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380277 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380280 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380283 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380286 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380289 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380292 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380294 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380296 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380300 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380303 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380305 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380308 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380310 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380313 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380315 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380318 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380320 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380322 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:44.392043 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380326 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380329 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380332 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380335 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380338 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380340 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380343 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380345 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380349 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380352 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380355 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380357 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380360 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380362 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380365 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380367 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380370 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380372 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380375 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:44.392695 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380377 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380380 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380382 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380387 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380389 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380393 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380397 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380399 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380402 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380405 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380407 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380410 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380412 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380415 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380417 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380420 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380423 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380425 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380428 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:44.393410 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380430 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380433 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380436 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380439 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380442 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380444 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380446 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.380449 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.380984 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.390040 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.390060 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.390890 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.390904 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.390999 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391006 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:44.394220 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391012 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391018 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391022 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391027 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391032 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391037 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391044 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391050 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391055 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391059 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391064 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391068 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391073 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391078 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391083 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391088 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391092 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391096 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391101 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391105 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:44.394673 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391110 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391114 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391118 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391123 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391127 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391131 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391136 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391140 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391145 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391149 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391153 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391157 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391161 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391166 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391171 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391176 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391181 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391185 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391189 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391193 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:44.395291 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391200 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391206 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391211 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391215 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391220 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391225 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391229 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391233 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391237 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391242 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391246 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391250 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391254 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391258 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391262 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391267 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391271 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391275 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391280 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391284 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:44.395816 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391289 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391293 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391297 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391301 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391305 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391309 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391313 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391318 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391322 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391326 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391330 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391334 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391338 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391342 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391346 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391353 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391358 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391365 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391370 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:44.396363 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391374 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391379 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391383 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391388 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391392 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391397 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391402 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391406 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391411 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391415 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391419 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391423 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391427 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391431 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391436 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391440 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391444 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:44.396997 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391448 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.391456 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391656 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391666 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391670 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391675 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391679 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391683 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391687 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391691 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391695 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391700 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391706 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391714 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:38:44.397428 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391720 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391725 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391730 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391734 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391740 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391744 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391749 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391753 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391758 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391762 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391766 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391770 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391774 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391778 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391782 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391787 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391791 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391795 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391799 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391803 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:38:44.397800 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391808 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391812 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391816 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391820 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391824 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391828 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391832 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391838 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391843 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391848 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391852 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391856 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391860 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391865 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391870 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391874 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391878 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391882 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391886 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:38:44.398275 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391890 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391894 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391898 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391903 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391907 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391911 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391915 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391919 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391923 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391928 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391931 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391936 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391940 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391944 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391948 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391952 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391956 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391960 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391965 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391969 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:38:44.398752 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391973 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391977 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391981 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391985 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391990 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391994 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.391998 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392008 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392013 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392017 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392021 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392026 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392030 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392035 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392039 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392042 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392046 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392050 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392054 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392058 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:38:44.399233 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392062 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392066 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392070 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392074 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392079 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392083 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392088 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:44.392092 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.392100 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.392257 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.394806 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.396073 2574 server.go:1019] "Starting client certificate rotation" Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.396177 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 01:38:44.399730 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.396208 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 01:38:44.400065 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.398177 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 01:38:44.400065 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.399838 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 01:38:44.407932 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.407911 2574 log.go:25] "Validated CRI v1 runtime API" Jun 15 01:38:44.410905 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.410892 2574 log.go:25] "Validated CRI v1 image API" Jun 15 01:38:44.411737 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.411719 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 01:38:44.415524 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.415505 2574 fs.go:135] Filesystem UUIDs: map[78b10a56-f111-422d-b2b6-cddef39c566f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 beea4e70-bc2d-4691-9ac2-cfbf96338f77:/dev/nvme0n1p3] Jun 15 01:38:44.415614 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.415523 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 01:38:44.420319 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.420118 2574 manager.go:216] Machine: {Timestamp:2026-06-15 01:38:44.419659466 +0000 UTC m=+0.270590311 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099937 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fc3bfb2d1c4c44b35ff8790e3a9ed SystemUUID:ec2fc3bf-b2d1-c4c4-4b35-ff8790e3a9ed BootID:22344c99-e53f-401b-856c-e6b4f49a2ce8 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:e1:c4:94:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:e1:c4:94:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:3e:c2:27:16:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 01:38:44.420319 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.420310 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 01:38:44.420463 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.420442 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 01:38:44.422962 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.422940 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 01:38:44.423099 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.422965 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-94.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 01:38:44.424069 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.424057 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 01:38:44.424102 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.424073 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 01:38:44.424102 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.424081 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 01:38:44.424722 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.424712 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 01:38:44.425509 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.425500 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 01:38:44.425862 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.425847 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 01:38:44.428703 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.428691 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 15 01:38:44.428825 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.428816 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 01:38:44.428857 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.428846 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 15 01:38:44.428888 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.428858 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 01:38:44.428888 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.428870 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 01:38:44.428888 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.428878 2574 kubelet.go:398] "Adding apiserver pod source" Jun 15 01:38:44.428888 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.428886 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 01:38:44.429199 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.429185 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 01:38:44.429252 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.429207 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 01:38:44.431031 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.431016 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 01:38:44.432299 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.432286 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 01:38:44.432347 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.432316 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 01:38:44.433303 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433291 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433307 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433313 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433317 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433326 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433331 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433339 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433344 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433350 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433355 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433363 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 01:38:44.433366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433368 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 01:38:44.433967 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433957 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 01:38:44.433967 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.433965 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 01:38:44.436933 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.436920 2574 server.go:1268] "Started kubelet" Jun 15 01:38:44.437062 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.436997 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 01:38:44.437062 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.437067 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 01:38:44.437250 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.437009 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 01:38:44.437887 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.437869 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-94.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 01:38:44.437887 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.437874 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 01:38:44.438050 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.437891 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 01:38:44.437898 ip-10-0-135-94 systemd[1]: Started Kubernetes Kubelet. Jun 15 01:38:44.438376 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.438363 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 01:38:44.439423 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.439411 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 15 01:38:44.441579 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.440831 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-94.ec2.internal.18b91d76f9d9e551 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-94.ec2.internal,UID:ip-10-0-135-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-94.ec2.internal,},FirstTimestamp:2026-06-15 01:38:44.436895057 +0000 UTC m=+0.287825882,LastTimestamp:2026-06-15 01:38:44.436895057 +0000 UTC m=+0.287825882,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-94.ec2.internal,}" Jun 15 01:38:44.443065 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.443045 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 01:38:44.444034 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.443153 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 01:38:44.445236 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.444162 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:44.445617 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.445596 2574 factory.go:55] Registering systemd factory Jun 15 01:38:44.445695 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.445622 2574 factory.go:223] Registration of the systemd container factory successfully Jun 15 01:38:44.445695 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.445623 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 01:38:44.445996 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.445980 2574 factory.go:153] Registering CRI-O factory Jun 15 01:38:44.445996 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446004 2574 factory.go:223] Registration of the crio container factory successfully Jun 15 01:38:44.446126 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446063 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 01:38:44.446126 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446069 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 01:38:44.446126 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446085 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 01:38:44.446126 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446093 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bfh8p" Jun 15 01:38:44.446126 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446085 2574 factory.go:103] Registering Raw factory Jun 15 01:38:44.446381 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446135 2574 manager.go:1196] Started watching for new ooms in manager Jun 15 01:38:44.446381 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446322 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 15 01:38:44.446381 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446332 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 15 01:38:44.446677 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.446661 2574 manager.go:349] Starting recovery of all containers Jun 15 01:38:44.447330 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.447304 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 01:38:44.447423 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.447333 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-94.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 01:38:44.452166 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.452138 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 01:38:44.452307 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.452291 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bfh8p" Jun 15 01:38:44.453755 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.453729 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 01:38:44.457973 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.457957 2574 manager.go:354] Recovery completed Jun 15 01:38:44.462526 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.462511 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:44.464242 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.464228 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:44.464327 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.464260 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:44.464327 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.464274 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:44.464831 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.464818 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 01:38:44.464892 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.464832 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 01:38:44.464892 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.464836 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:44.464892 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.464849 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 15 01:38:44.465542 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.465528 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:44.465594 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.465552 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:44.465594 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.465561 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:44.466193 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.466177 2574 policy_none.go:49] "None policy: Start" Jun 15 01:38:44.466298 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.466206 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 01:38:44.466298 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.466219 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 01:38:44.466450 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.466391 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-94.ec2.internal.18b91d76fb7b32bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-94.ec2.internal,UID:ip-10-0-135-94.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-94.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-94.ec2.internal,},FirstTimestamp:2026-06-15 01:38:44.464243388 +0000 UTC m=+0.315174217,LastTimestamp:2026-06-15 01:38:44.464243388 +0000 UTC m=+0.315174217,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-94.ec2.internal,}" Jun 15 01:38:44.467416 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.467401 2574 policy_none.go:47] "Start" Jun 15 01:38:44.502195 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.502182 2574 manager.go:337] "Starting Device Plugin manager" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.502246 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.502260 2574 server.go:87] "Starting device plugin registration server" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.502478 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.502487 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.502579 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.502683 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.502694 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.503186 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.503235 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.503286 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.503318 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.503355 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.503419 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 01:38:44.509992 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.505404 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:44.603303 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.603286 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:44.603617 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.603598 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal"] Jun 15 01:38:44.603703 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.603680 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:44.604304 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.604289 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:44.604374 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.604316 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:44.604374 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.604343 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:44.604374 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.604369 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.604840 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.604825 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:44.604903 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.604852 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:44.604903 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.604861 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:44.606178 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606167 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:44.606306 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606282 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.606360 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606329 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:44.606843 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606825 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:44.606905 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606851 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:44.606905 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606861 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:44.606984 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606833 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:44.606984 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606928 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:44.606984 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.606940 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:44.608023 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.608009 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.608072 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.608036 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:38:44.608673 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.608659 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:38:44.608727 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.608682 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:38:44.608727 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.608692 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:38:44.611713 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.611698 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.611790 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.611716 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-94.ec2.internal\": node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:44.625983 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.625943 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:44.632240 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.632223 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-94.ec2.internal\" not found" node="ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.635490 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.635475 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-94.ec2.internal\" not found" node="ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.647531 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.647511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/406f3ba4471af0eee5340b4f98906d46-config\") pod \"kube-apiserver-proxy-ip-10-0-135-94.ec2.internal\" (UID: \"406f3ba4471af0eee5340b4f98906d46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.647621 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.647542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693181edb404df3c85dcbc52171a51c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal\" (UID: \"693181edb404df3c85dcbc52171a51c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.647621 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.647569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693181edb404df3c85dcbc52171a51c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal\" (UID: \"693181edb404df3c85dcbc52171a51c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.726568 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.726548 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:44.748183 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.748168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693181edb404df3c85dcbc52171a51c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal\" (UID: \"693181edb404df3c85dcbc52171a51c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.748268 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.748190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693181edb404df3c85dcbc52171a51c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal\" (UID: \"693181edb404df3c85dcbc52171a51c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.748268 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.748206 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/406f3ba4471af0eee5340b4f98906d46-config\") pod \"kube-apiserver-proxy-ip-10-0-135-94.ec2.internal\" (UID: \"406f3ba4471af0eee5340b4f98906d46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.748268 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.748245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/406f3ba4471af0eee5340b4f98906d46-config\") pod \"kube-apiserver-proxy-ip-10-0-135-94.ec2.internal\" (UID: \"406f3ba4471af0eee5340b4f98906d46\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.748367 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.748272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693181edb404df3c85dcbc52171a51c8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal\" (UID: \"693181edb404df3c85dcbc52171a51c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.748367 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.748281 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693181edb404df3c85dcbc52171a51c8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal\" (UID: \"693181edb404df3c85dcbc52171a51c8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.827419 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.827392 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:44.928058 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:44.928012 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:44.935302 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.935290 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:44.938340 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:44.938302 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" Jun 15 01:38:45.028097 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:45.028064 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:45.128578 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:45.128533 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:45.229034 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:45.228974 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:45.329464 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:45.329435 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:45.394083 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:45.394046 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693181edb404df3c85dcbc52171a51c8.slice/crio-d86673a998a07de45af8decf182336594bec7eba29309dc3f4b65843145b316f WatchSource:0}: Error finding container d86673a998a07de45af8decf182336594bec7eba29309dc3f4b65843145b316f: Status 404 returned error can't find the container with id d86673a998a07de45af8decf182336594bec7eba29309dc3f4b65843145b316f Jun 15 01:38:45.394568 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:45.394470 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406f3ba4471af0eee5340b4f98906d46.slice/crio-2c6549e1f9d8d0d8b6ee9a978a7f67a5fc92ae66bcee8d981f3e93981d5aeb22 WatchSource:0}: Error finding container 2c6549e1f9d8d0d8b6ee9a978a7f67a5fc92ae66bcee8d981f3e93981d5aeb22: Status 404 returned error can't find the container with id 2c6549e1f9d8d0d8b6ee9a978a7f67a5fc92ae66bcee8d981f3e93981d5aeb22 Jun 15 01:38:45.395546 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.395530 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 01:38:45.395709 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.395691 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 01:38:45.398788 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.398771 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:38:45.430382 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:45.430350 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:45.456410 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.456387 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 01:33:44 +0000 UTC" deadline="2028-02-15 04:42:30.482513774 +0000 UTC" Jun 15 01:38:45.456410 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.456408 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14643h3m45.02610833s" Jun 15 01:38:45.506498 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.506431 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" event={"ID":"406f3ba4471af0eee5340b4f98906d46","Type":"ContainerStarted","Data":"2c6549e1f9d8d0d8b6ee9a978a7f67a5fc92ae66bcee8d981f3e93981d5aeb22"} Jun 15 01:38:45.507383 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.507364 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" event={"ID":"693181edb404df3c85dcbc52171a51c8","Type":"ContainerStarted","Data":"d86673a998a07de45af8decf182336594bec7eba29309dc3f4b65843145b316f"} Jun 15 01:38:45.530460 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:45.530441 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:45.630977 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:45.630950 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-94.ec2.internal\" not found" Jun 15 01:38:45.650468 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.650453 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:45.745906 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.745885 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" Jun 15 01:38:45.754732 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.754715 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 01:38:45.756132 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.756115 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" Jun 15 01:38:45.764520 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.764464 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 01:38:45.813718 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.813698 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:45.931054 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:45.931032 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:46.429540 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.429511 2574 apiserver.go:52] "Watching apiserver" Jun 15 01:38:46.434551 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.434528 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 01:38:46.435020 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.434990 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-w678h","openshift-network-operator/iptables-alerter-sczlg","openshift-ovn-kubernetes/ovnkube-node-4pcf7","kube-system/global-pull-secret-syncer-22rjz","kube-system/konnectivity-agent-zgndx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq","openshift-cluster-node-tuning-operator/tuned-szbvk","openshift-dns/node-resolver-t8rgh","openshift-image-registry/node-ca-w5pfh","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal","openshift-multus/network-metrics-daemon-ddm5s","kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal","openshift-multus/multus-additional-cni-plugins-bndl9","openshift-multus/multus-j6jqq"] Jun 15 01:38:46.436580 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.436559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.438391 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.438319 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.438584 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.438512 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 01:38:46.438584 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.438562 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:38:46.438724 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.438690 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-grvm4\"" Jun 15 01:38:46.440130 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.440034 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.441917 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.440437 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 01:38:46.441917 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.440627 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 01:38:46.442060 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.442008 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 01:38:46.442113 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.442085 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t7cr5\"" Jun 15 01:38:46.442113 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.442091 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 01:38:46.442208 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.442088 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 01:38:46.443307 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.442755 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.443307 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.442845 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 01:38:46.443307 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.442893 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:38:46.443307 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.443120 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 01:38:46.443307 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.443138 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 01:38:46.443307 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.443228 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 01:38:46.443897 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.443866 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 01:38:46.443996 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.443906 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 01:38:46.444480 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.444464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:38:46.444595 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.444579 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7n9jc\"" Jun 15 01:38:46.445215 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.445152 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 01:38:46.446021 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.446004 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d2bkx\"" Jun 15 01:38:46.446513 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.446492 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.447003 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.446987 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 01:38:46.447095 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.447071 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 01:38:46.448027 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.447921 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 01:38:46.448027 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.448001 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.448436 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.448411 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 01:38:46.448538 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.448521 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 01:38:46.448700 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.448633 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fz84t\"" Jun 15 01:38:46.449333 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.449224 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:46.449333 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.449293 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:38:46.449533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.449516 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 01:38:46.449946 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.449930 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 01:38:46.450083 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.450064 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmrk6\"" Jun 15 01:38:46.450162 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.450099 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 01:38:46.450564 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.450546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.452036 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.452018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.452336 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.452319 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:38:46.452458 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.452442 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 01:38:46.452515 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.452496 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 01:38:46.452796 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.452778 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2ffzg\"" Jun 15 01:38:46.453467 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.453449 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:46.453561 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.453524 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:38:46.453713 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.453697 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s5qk6\"" Jun 15 01:38:46.453817 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.453700 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 01:38:46.455068 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455050 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.455421 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455399 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9zk6\" (UniqueName: \"kubernetes.io/projected/77b085cd-9ee6-43d9-9009-36d8d079e467-kube-api-access-j9zk6\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.455504 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455443 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysctl-conf\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.455504 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-lib-modules\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.455504 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.455685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455508 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.455685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-kubelet\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.455685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.455685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455568 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-slash\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.455685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455589 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-env-overrides\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.455685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-kubelet-config\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.455685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-systemd\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.455685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlh6s\" (UniqueName: \"kubernetes.io/projected/25e574c2-6beb-402c-b25c-1dc459ffbad5-kube-api-access-vlh6s\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92dabc05-371d-4409-9ed1-945647845c72-agent-certs\") pod \"konnectivity-agent-zgndx\" (UID: \"92dabc05-371d-4409-9ed1-945647845c72\") " pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-etc-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455734 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d585f82-4710-439c-8813-91aea3d6e929-tmp\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5z9z\" (UniqueName: \"kubernetes.io/projected/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-kube-api-access-r5z9z\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-ovn\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-kubernetes\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.455977 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysctl-d\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456013 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbxld\" (UniqueName: \"kubernetes.io/projected/3d585f82-4710-439c-8813-91aea3d6e929-kube-api-access-lbxld\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456080 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovnkube-script-lib\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-device-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456145 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-sys\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-etc-selinux\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.456185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-run-netns\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456214 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-node-log\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-sys-fs\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-host\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456302 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-dbus\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456323 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-var-lib-kubelet\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456345 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cnibin\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-var-lib-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456465 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-cni-bin\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456512 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-socket-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-systemd-units\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-systemd\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-cni-netd\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-registration-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.456893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-run\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovnkube-config\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-os-release\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-log-socket\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-modprobe-d\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456787 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysconfig\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-system-cni-dir\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovn-node-metrics-cert\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92dabc05-371d-4409-9ed1-945647845c72-konnectivity-ca\") pod \"konnectivity-agent-zgndx\" (UID: \"92dabc05-371d-4409-9ed1-945647845c72\") " pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d585f82-4710-439c-8813-91aea3d6e929-etc-tuned\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456923 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456949 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s2wmb\"" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.456981 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 01:38:46.457667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.457657 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 01:38:46.477151 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.477121 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7hhls" Jun 15 01:38:46.484461 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.484443 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7hhls" Jun 15 01:38:46.546854 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.546833 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 01:38:46.557369 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557349 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.557470 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557379 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f925710-db9f-4abf-813e-32b25b5c0483-iptables-alerter-script\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.557470 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.557470 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9zk6\" (UniqueName: \"kubernetes.io/projected/77b085cd-9ee6-43d9-9009-36d8d079e467-kube-api-access-j9zk6\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.557470 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysctl-conf\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.557470 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-lib-modules\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557464 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557504 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-kubelet-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557526 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-kubelet\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557578 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysctl-conf\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f925710-db9f-4abf-813e-32b25b5c0483-host-slash\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557627 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-kubelet\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-lib-modules\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-slash\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-env-overrides\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557735 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-cni-multus\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557759 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8k6c\" (UniqueName: \"kubernetes.io/projected/01c71114-88ea-43c9-9b1e-5993cac19357-kube-api-access-v8k6c\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-slash\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.557790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-kubelet-config\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557819 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-systemd\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-systemd\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlh6s\" (UniqueName: \"kubernetes.io/projected/25e574c2-6beb-402c-b25c-1dc459ffbad5-kube-api-access-vlh6s\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-kubelet-config\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.557964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-conf-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558008 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f2a2af3-7443-492d-a735-04f9c1e8961b-hosts-file\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558036 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92dabc05-371d-4409-9ed1-945647845c72-agent-certs\") pod \"konnectivity-agent-zgndx\" (UID: \"92dabc05-371d-4409-9ed1-945647845c72\") " pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558077 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-etc-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558137 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-etc-kubernetes\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-env-overrides\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d585f82-4710-439c-8813-91aea3d6e929-tmp\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558219 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5z9z\" (UniqueName: \"kubernetes.io/projected/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-kube-api-access-r5z9z\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558235 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558167 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-etc-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558250 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.558533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-ovn\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558278 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-ovn\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-netns\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-kubernetes\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558359 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysctl-d\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbxld\" (UniqueName: \"kubernetes.io/projected/3d585f82-4710-439c-8813-91aea3d6e929-kube-api-access-lbxld\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558429 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-kubernetes\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558473 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovnkube-script-lib\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558498 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-os-release\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-kubelet\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-device-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-sys\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmr2s\" (UniqueName: \"kubernetes.io/projected/758f4a15-f524-48f4-a92e-555379652796-kube-api-access-zmr2s\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-device-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-system-cni-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.559398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysctl-d\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-etc-selinux\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-sys\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-run-netns\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558733 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-etc-selinux\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-node-log\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558744 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558755 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-run-netns\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558781 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-node-log\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/758f4a15-f524-48f4-a92e-555379652796-serviceca\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-cni-bin\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-multus-certs\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-sys-fs\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-host\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558995 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-sys-fs\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.560204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.558996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-host\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovnkube-script-lib\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-dbus\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-var-lib-kubelet\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cnibin\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559119 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-var-lib-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-var-lib-kubelet\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559145 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-cni-bin\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559173 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-cnibin\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-socket-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-run-ovn-kubernetes\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559217 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-cni-bin\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-systemd-units\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-systemd\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559453 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-cni-netd\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:46.560988 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-socket-dir-parent\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-run-systemd\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-k8s-cni-cncf-io\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559196 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-var-lib-openvswitch\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559544 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-registration-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-dbus\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-run\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559574 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovnkube-config\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r75nz\" (UniqueName: \"kubernetes.io/projected/6f925710-db9f-4abf-813e-32b25b5c0483-kube-api-access-r75nz\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-systemd-units\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d25f315-6493-497b-b5b5-0e615401d7ee-cni-binary-copy\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2a2af3-7443-492d-a735-04f9c1e8961b-tmp-dir\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559633 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-os-release\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-registration-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559667 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-log-socket\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559694 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-log-socket\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:46.561842 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559726 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559735 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-run\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-modprobe-d\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysconfig\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559797 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-system-cni-dir\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559290 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/77b085cd-9ee6-43d9-9009-36d8d079e467-socket-dir\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovn-node-metrics-cert\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559849 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758f4a15-f524-48f4-a92e-555379652796-host\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-cni-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-cnibin\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559923 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92dabc05-371d-4409-9ed1-945647845c72-konnectivity-ca\") pod \"konnectivity-agent-zgndx\" (UID: \"92dabc05-371d-4409-9ed1-945647845c72\") " pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559945 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d585f82-4710-439c-8813-91aea3d6e929-etc-tuned\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559950 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-modprobe-d\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-hostroot\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-daemon-config\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.560016 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfrjl\" (UniqueName: \"kubernetes.io/projected/7d25f315-6493-497b-b5b5-0e615401d7ee-kube-api-access-wfrjl\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.560034 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.560038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d585f82-4710-439c-8813-91aea3d6e929-etc-sysconfig\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.562666 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.560065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvb4n\" (UniqueName: \"kubernetes.io/projected/7f2a2af3-7443-492d-a735-04f9c1e8961b-kube-api-access-gvb4n\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.560127 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret podName:9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:47.060084623 +0000 UTC m=+2.911015457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret") pod "global-pull-secret-syncer-22rjz" (UID: "9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.560152 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovnkube-config\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.559587 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/25e574c2-6beb-402c-b25c-1dc459ffbad5-host-cni-netd\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.560484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-system-cni-dir\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.560546 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-os-release\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.560604 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/92dabc05-371d-4409-9ed1-945647845c72-konnectivity-ca\") pod \"konnectivity-agent-zgndx\" (UID: \"92dabc05-371d-4409-9ed1-945647845c72\") " pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.561520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/92dabc05-371d-4409-9ed1-945647845c72-agent-certs\") pod \"konnectivity-agent-zgndx\" (UID: \"92dabc05-371d-4409-9ed1-945647845c72\") " pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.561732 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d585f82-4710-439c-8813-91aea3d6e929-tmp\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.562258 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/25e574c2-6beb-402c-b25c-1dc459ffbad5-ovn-node-metrics-cert\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.563495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.562582 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d585f82-4710-439c-8813-91aea3d6e929-etc-tuned\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.566596 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.566532 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5z9z\" (UniqueName: \"kubernetes.io/projected/4d20763a-906f-4ae3-ab71-457ec9b2a1b2-kube-api-access-r5z9z\") pod \"multus-additional-cni-plugins-bndl9\" (UID: \"4d20763a-906f-4ae3-ab71-457ec9b2a1b2\") " pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.566717 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.566663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbxld\" (UniqueName: \"kubernetes.io/projected/3d585f82-4710-439c-8813-91aea3d6e929-kube-api-access-lbxld\") pod \"tuned-szbvk\" (UID: \"3d585f82-4710-439c-8813-91aea3d6e929\") " pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.566776 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.566752 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlh6s\" (UniqueName: \"kubernetes.io/projected/25e574c2-6beb-402c-b25c-1dc459ffbad5-kube-api-access-vlh6s\") pod \"ovnkube-node-4pcf7\" (UID: \"25e574c2-6beb-402c-b25c-1dc459ffbad5\") " pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.566853 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.566831 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9zk6\" (UniqueName: \"kubernetes.io/projected/77b085cd-9ee6-43d9-9009-36d8d079e467-kube-api-access-j9zk6\") pod \"aws-ebs-csi-driver-node-btvzq\" (UID: \"77b085cd-9ee6-43d9-9009-36d8d079e467\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.660747 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-cni-multus\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.660747 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660750 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8k6c\" (UniqueName: \"kubernetes.io/projected/01c71114-88ea-43c9-9b1e-5993cac19357-kube-api-access-v8k6c\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:46.660968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660778 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-conf-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.660968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660858 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-cni-multus\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.660968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f2a2af3-7443-492d-a735-04f9c1e8961b-hosts-file\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.660968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660941 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-etc-kubernetes\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.660968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-conf-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.660968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-netns\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.660997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-os-release\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-kubelet\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmr2s\" (UniqueName: \"kubernetes.io/projected/758f4a15-f524-48f4-a92e-555379652796-kube-api-access-zmr2s\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661052 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-netns\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-system-cni-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661101 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/758f4a15-f524-48f4-a92e-555379652796-serviceca\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661091 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-etc-kubernetes\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7f2a2af3-7443-492d-a735-04f9c1e8961b-hosts-file\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661119 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-cni-bin\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-multus-certs\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-socket-dir-parent\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-k8s-cni-cncf-io\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r75nz\" (UniqueName: \"kubernetes.io/projected/6f925710-db9f-4abf-813e-32b25b5c0483-kube-api-access-r75nz\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.661273 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d25f315-6493-497b-b5b5-0e615401d7ee-cni-binary-copy\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2a2af3-7443-492d-a735-04f9c1e8961b-tmp-dir\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758f4a15-f524-48f4-a92e-555379652796-host\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-cni-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-os-release\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-cnibin\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661398 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-system-cni-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-hostroot\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-k8s-cni-cncf-io\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661446 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-hostroot\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661447 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-daemon-config\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-kubelet\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661481 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfrjl\" (UniqueName: \"kubernetes.io/projected/7d25f315-6493-497b-b5b5-0e615401d7ee-kube-api-access-wfrjl\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvb4n\" (UniqueName: \"kubernetes.io/projected/7f2a2af3-7443-492d-a735-04f9c1e8961b-kube-api-access-gvb4n\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.661507 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f925710-db9f-4abf-813e-32b25b5c0483-iptables-alerter-script\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661553 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-socket-dir-parent\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f925710-db9f-4abf-813e-32b25b5c0483-host-slash\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.661578 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:47.16155892 +0000 UTC m=+3.012489746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6f925710-db9f-4abf-813e-32b25b5c0483-host-slash\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661602 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/758f4a15-f524-48f4-a92e-555379652796-serviceca\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/758f4a15-f524-48f4-a92e-555379652796-host\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-cni-dir\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-var-lib-cni-bin\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661751 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-cnibin\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661505 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d25f315-6493-497b-b5b5-0e615401d7ee-host-run-multus-certs\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.661857 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f2a2af3-7443-492d-a735-04f9c1e8961b-tmp-dir\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.662020 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d25f315-6493-497b-b5b5-0e615401d7ee-multus-daemon-config\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.662077 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d25f315-6493-497b-b5b5-0e615401d7ee-cni-binary-copy\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.662769 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.662219 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6f925710-db9f-4abf-813e-32b25b5c0483-iptables-alerter-script\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.669545 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.669526 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:46.669545 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.669546 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:46.669741 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.669560 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thgnz for pod openshift-network-diagnostics/network-check-target-w678h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:46.669741 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:46.669622 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz podName:86dc7fb6-9951-46aa-be15-d2037492adca nodeName:}" failed. No retries permitted until 2026-06-15 01:38:47.169607064 +0000 UTC m=+3.020537894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-thgnz" (UniqueName: "kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz") pod "network-check-target-w678h" (UID: "86dc7fb6-9951-46aa-be15-d2037492adca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:46.671053 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.671026 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8k6c\" (UniqueName: \"kubernetes.io/projected/01c71114-88ea-43c9-9b1e-5993cac19357-kube-api-access-v8k6c\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:46.671681 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.671609 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r75nz\" (UniqueName: \"kubernetes.io/projected/6f925710-db9f-4abf-813e-32b25b5c0483-kube-api-access-r75nz\") pod \"iptables-alerter-sczlg\" (UID: \"6f925710-db9f-4abf-813e-32b25b5c0483\") " pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.671762 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.671721 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmr2s\" (UniqueName: \"kubernetes.io/projected/758f4a15-f524-48f4-a92e-555379652796-kube-api-access-zmr2s\") pod \"node-ca-w5pfh\" (UID: \"758f4a15-f524-48f4-a92e-555379652796\") " pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.672048 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.672013 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfrjl\" (UniqueName: \"kubernetes.io/projected/7d25f315-6493-497b-b5b5-0e615401d7ee-kube-api-access-wfrjl\") pod \"multus-j6jqq\" (UID: \"7d25f315-6493-497b-b5b5-0e615401d7ee\") " pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.672327 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.672312 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvb4n\" (UniqueName: \"kubernetes.io/projected/7f2a2af3-7443-492d-a735-04f9c1e8961b-kube-api-access-gvb4n\") pod \"node-resolver-t8rgh\" (UID: \"7f2a2af3-7443-492d-a735-04f9c1e8961b\") " pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:46.751181 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.751121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-szbvk" Jun 15 01:38:46.759716 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.759691 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bndl9" Jun 15 01:38:46.767521 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.767499 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:38:46.768242 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.768226 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:38:46.773737 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.773719 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:38:46.780488 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.780463 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" Jun 15 01:38:46.787138 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.787121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w5pfh" Jun 15 01:38:46.797712 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.797694 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sczlg" Jun 15 01:38:46.802447 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.802432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j6jqq" Jun 15 01:38:46.807193 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:46.807175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t8rgh" Jun 15 01:38:47.063845 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.063771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:47.063999 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.063937 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:47.064058 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.064026 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret podName:9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:48.064005113 +0000 UTC m=+3.914935926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret") pod "global-pull-secret-syncer-22rjz" (UID: "9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:47.161545 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.161508 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d585f82_4710_439c_8813_91aea3d6e929.slice/crio-9c32ab7bf3a4cded31dce25d9b44b299d4b53e1727ab9c3616fb2e4518126fdd WatchSource:0}: Error finding container 9c32ab7bf3a4cded31dce25d9b44b299d4b53e1727ab9c3616fb2e4518126fdd: Status 404 returned error can't find the container with id 9c32ab7bf3a4cded31dce25d9b44b299d4b53e1727ab9c3616fb2e4518126fdd Jun 15 01:38:47.162567 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.162540 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92dabc05_371d_4409_9ed1_945647845c72.slice/crio-dfb7eb687524be5c02179a7cc448c738cd5b581790ca4d8f4785930fd5f8a9b3 WatchSource:0}: Error finding container dfb7eb687524be5c02179a7cc448c738cd5b581790ca4d8f4785930fd5f8a9b3: Status 404 returned error can't find the container with id dfb7eb687524be5c02179a7cc448c738cd5b581790ca4d8f4785930fd5f8a9b3 Jun 15 01:38:47.163559 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.163506 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758f4a15_f524_48f4_a92e_555379652796.slice/crio-0cdd416e3826a8901cc558304d594afe0b6bbecc23f45b92a6b8e05dad575948 WatchSource:0}: Error finding container 0cdd416e3826a8901cc558304d594afe0b6bbecc23f45b92a6b8e05dad575948: Status 404 returned error can't find the container with id 0cdd416e3826a8901cc558304d594afe0b6bbecc23f45b92a6b8e05dad575948 Jun 15 01:38:47.164116 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.164092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:47.164262 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.164247 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:47.164323 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.164312 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:48.164293281 +0000 UTC m=+4.015224094 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:47.167115 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.167097 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d20763a_906f_4ae3_ab71_457ec9b2a1b2.slice/crio-ac84170138a2fb63895296beee5de795fae615bdbdd2a89d6099a09329b29bf8 WatchSource:0}: Error finding container ac84170138a2fb63895296beee5de795fae615bdbdd2a89d6099a09329b29bf8: Status 404 returned error can't find the container with id ac84170138a2fb63895296beee5de795fae615bdbdd2a89d6099a09329b29bf8 Jun 15 01:38:47.167665 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.167622 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2a2af3_7443_492d_a735_04f9c1e8961b.slice/crio-78eb7b6218a5a1ddb49ede58d19f7ffa3a0e5fa6b83be472cdceaa8c64aed293 WatchSource:0}: Error finding container 78eb7b6218a5a1ddb49ede58d19f7ffa3a0e5fa6b83be472cdceaa8c64aed293: Status 404 returned error can't find the container with id 78eb7b6218a5a1ddb49ede58d19f7ffa3a0e5fa6b83be472cdceaa8c64aed293 Jun 15 01:38:47.169069 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.169040 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b085cd_9ee6_43d9_9009_36d8d079e467.slice/crio-ee3c60226f2dcce8701ae03656b82b772531e32d499be934eff7e0ce990d3256 WatchSource:0}: Error finding container ee3c60226f2dcce8701ae03656b82b772531e32d499be934eff7e0ce990d3256: Status 404 returned error can't find the container with id ee3c60226f2dcce8701ae03656b82b772531e32d499be934eff7e0ce990d3256 Jun 15 01:38:47.169973 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.169818 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f925710_db9f_4abf_813e_32b25b5c0483.slice/crio-454de613f58773493b713cfd0adc9b44ac27c4255b4cf00c6129343a1e04f316 WatchSource:0}: Error finding container 454de613f58773493b713cfd0adc9b44ac27c4255b4cf00c6129343a1e04f316: Status 404 returned error can't find the container with id 454de613f58773493b713cfd0adc9b44ac27c4255b4cf00c6129343a1e04f316 Jun 15 01:38:47.171516 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.171454 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d25f315_6493_497b_b5b5_0e615401d7ee.slice/crio-2bd945e75bb75bec6f767951ec14036b307de054f7570b93e6c3216a502bc40d WatchSource:0}: Error finding container 2bd945e75bb75bec6f767951ec14036b307de054f7570b93e6c3216a502bc40d: Status 404 returned error can't find the container with id 2bd945e75bb75bec6f767951ec14036b307de054f7570b93e6c3216a502bc40d Jun 15 01:38:47.172685 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:38:47.172125 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e574c2_6beb_402c_b25c_1dc459ffbad5.slice/crio-29e73f6e249d192479f495a91c8d75362dd171bb9b9a2b368e00da47cde67437 WatchSource:0}: Error finding container 29e73f6e249d192479f495a91c8d75362dd171bb9b9a2b368e00da47cde67437: Status 404 returned error can't find the container with id 29e73f6e249d192479f495a91c8d75362dd171bb9b9a2b368e00da47cde67437 Jun 15 01:38:47.264873 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.264853 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:47.265012 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.264996 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:47.265057 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.265020 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:47.265057 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.265032 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thgnz for pod openshift-network-diagnostics/network-check-target-w678h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:47.265167 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.265083 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz podName:86dc7fb6-9951-46aa-be15-d2037492adca nodeName:}" failed. No retries permitted until 2026-06-15 01:38:48.26506871 +0000 UTC m=+4.115999522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-thgnz" (UniqueName: "kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz") pod "network-check-target-w678h" (UID: "86dc7fb6-9951-46aa-be15-d2037492adca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:47.487277 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.487193 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 01:33:46 +0000 UTC" deadline="2027-12-22 15:16:51.594473631 +0000 UTC" Jun 15 01:38:47.487277 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.487250 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13333h38m4.107228967s" Jun 15 01:38:47.504939 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.504459 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:47.504939 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:47.504592 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:38:47.516441 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.516411 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szbvk" event={"ID":"3d585f82-4710-439c-8813-91aea3d6e929","Type":"ContainerStarted","Data":"9c32ab7bf3a4cded31dce25d9b44b299d4b53e1727ab9c3616fb2e4518126fdd"} Jun 15 01:38:47.527147 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.527116 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"29e73f6e249d192479f495a91c8d75362dd171bb9b9a2b368e00da47cde67437"} Jun 15 01:38:47.537830 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.537751 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j6jqq" event={"ID":"7d25f315-6493-497b-b5b5-0e615401d7ee","Type":"ContainerStarted","Data":"2bd945e75bb75bec6f767951ec14036b307de054f7570b93e6c3216a502bc40d"} Jun 15 01:38:47.544141 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.544105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sczlg" event={"ID":"6f925710-db9f-4abf-813e-32b25b5c0483","Type":"ContainerStarted","Data":"454de613f58773493b713cfd0adc9b44ac27c4255b4cf00c6129343a1e04f316"} Jun 15 01:38:47.549110 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.549051 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zgndx" event={"ID":"92dabc05-371d-4409-9ed1-945647845c72","Type":"ContainerStarted","Data":"dfb7eb687524be5c02179a7cc448c738cd5b581790ca4d8f4785930fd5f8a9b3"} Jun 15 01:38:47.555822 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.555208 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" event={"ID":"406f3ba4471af0eee5340b4f98906d46","Type":"ContainerStarted","Data":"14b80e4e4b26c4c84728ecb990eef5f74314a1dc260bf27e28c8898c883bb638"} Jun 15 01:38:47.563032 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.561997 2574 generic.go:356] "Generic (PLEG): container finished" podID="693181edb404df3c85dcbc52171a51c8" containerID="614a9bf4de6e50f9a6445367ca583f8731adddbcfefa516a9af06a392facfb91" exitCode=0 Jun 15 01:38:47.563032 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.562064 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" event={"ID":"693181edb404df3c85dcbc52171a51c8","Type":"ContainerDied","Data":"614a9bf4de6e50f9a6445367ca583f8731adddbcfefa516a9af06a392facfb91"} Jun 15 01:38:47.566672 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.566413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" event={"ID":"77b085cd-9ee6-43d9-9009-36d8d079e467","Type":"ContainerStarted","Data":"ee3c60226f2dcce8701ae03656b82b772531e32d499be934eff7e0ce990d3256"} Jun 15 01:38:47.569934 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.569901 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t8rgh" event={"ID":"7f2a2af3-7443-492d-a735-04f9c1e8961b","Type":"ContainerStarted","Data":"78eb7b6218a5a1ddb49ede58d19f7ffa3a0e5fa6b83be472cdceaa8c64aed293"} Jun 15 01:38:47.576488 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.576434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerStarted","Data":"ac84170138a2fb63895296beee5de795fae615bdbdd2a89d6099a09329b29bf8"} Jun 15 01:38:47.580784 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.580763 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5pfh" event={"ID":"758f4a15-f524-48f4-a92e-555379652796","Type":"ContainerStarted","Data":"0cdd416e3826a8901cc558304d594afe0b6bbecc23f45b92a6b8e05dad575948"} Jun 15 01:38:47.584125 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:47.583492 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-94.ec2.internal" podStartSLOduration=2.583475926 podStartE2EDuration="2.583475926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:47.569434271 +0000 UTC m=+3.420365124" watchObservedRunningTime="2026-06-15 01:38:47.583475926 +0000 UTC m=+3.434406763" Jun 15 01:38:48.072004 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:48.071926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:48.072156 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.072099 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:48.072235 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.072162 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret podName:9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:50.072144736 +0000 UTC m=+5.923075550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret") pod "global-pull-secret-syncer-22rjz" (UID: "9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:48.173271 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:48.173234 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:48.173432 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.173413 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:48.173507 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.173475 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:50.17345596 +0000 UTC m=+6.024386775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:48.274224 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:48.274175 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:48.274415 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.274395 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:48.274487 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.274419 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:48.274487 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.274432 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thgnz for pod openshift-network-diagnostics/network-check-target-w678h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:48.274588 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.274488 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz podName:86dc7fb6-9951-46aa-be15-d2037492adca nodeName:}" failed. No retries permitted until 2026-06-15 01:38:50.274468538 +0000 UTC m=+6.125399375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-thgnz" (UniqueName: "kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz") pod "network-check-target-w678h" (UID: "86dc7fb6-9951-46aa-be15-d2037492adca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:48.488259 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:48.488196 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 01:33:46 +0000 UTC" deadline="2027-11-11 21:25:23.75484758 +0000 UTC" Jun 15 01:38:48.488259 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:48.488257 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12355h46m35.26659449s" Jun 15 01:38:48.506195 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:48.506159 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:48.506356 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.506281 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:38:48.506715 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:48.506695 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:48.506885 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:48.506863 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:38:48.598532 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:48.598497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" event={"ID":"693181edb404df3c85dcbc52171a51c8","Type":"ContainerStarted","Data":"f86da6ae044b23617f14b0135679dad77bbc73630d8c4c15bc2e84fe6c3264f9"} Jun 15 01:38:49.504325 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:49.504283 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:49.504800 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:49.504437 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:38:50.089424 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:50.089307 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:50.089588 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.089465 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:50.089588 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.089533 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret podName:9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:54.089515344 +0000 UTC m=+9.940446169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret") pod "global-pull-secret-syncer-22rjz" (UID: "9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:50.190728 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:50.190625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:50.190922 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.190770 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:50.190922 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.190839 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:38:54.190820908 +0000 UTC m=+10.041751726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:50.291606 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:50.291572 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:50.291805 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.291786 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:50.291879 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.291817 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:50.291879 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.291830 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thgnz for pod openshift-network-diagnostics/network-check-target-w678h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:50.291980 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.291894 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz podName:86dc7fb6-9951-46aa-be15-d2037492adca nodeName:}" failed. No retries permitted until 2026-06-15 01:38:54.291876002 +0000 UTC m=+10.142806839 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-thgnz" (UniqueName: "kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz") pod "network-check-target-w678h" (UID: "86dc7fb6-9951-46aa-be15-d2037492adca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:50.504413 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:50.503749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:50.504413 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.503875 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:38:50.504413 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:50.504227 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:50.504413 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:50.504327 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:38:51.504328 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:51.504261 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:51.504501 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:51.504399 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:38:52.504469 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:52.504010 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:52.504469 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:52.504127 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:38:52.504469 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:52.503964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:52.505080 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:52.504502 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:38:53.504803 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:53.504444 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:53.504803 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:53.504587 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:38:54.121856 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:54.121802 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:54.122031 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.121918 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:54.122031 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.121990 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret podName:9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:02.121968216 +0000 UTC m=+17.972899046 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret") pod "global-pull-secret-syncer-22rjz" (UID: "9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:38:54.222122 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:54.222091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:54.222278 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.222241 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:54.222343 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.222310 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:02.222284867 +0000 UTC m=+18.073215679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:38:54.322879 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:54.322847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:54.323041 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.323028 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:38:54.323099 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.323046 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:38:54.323099 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.323055 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thgnz for pod openshift-network-diagnostics/network-check-target-w678h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:54.323196 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.323103 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz podName:86dc7fb6-9951-46aa-be15-d2037492adca nodeName:}" failed. No retries permitted until 2026-06-15 01:39:02.32308533 +0000 UTC m=+18.174016162 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-thgnz" (UniqueName: "kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz") pod "network-check-target-w678h" (UID: "86dc7fb6-9951-46aa-be15-d2037492adca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:38:54.504830 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:54.504753 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:54.505251 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.504864 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:38:54.505251 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:54.504938 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:54.505251 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:54.505053 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:38:55.503804 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:55.503766 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:55.503967 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:55.503916 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:38:56.504457 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:56.504429 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:56.504896 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:56.504475 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:56.504896 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:56.504557 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:38:56.504896 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:56.504702 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:38:57.503719 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:57.503697 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:57.503848 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:57.503828 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:38:58.503946 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:58.503921 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:38:58.504384 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:58.503931 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:38:58.504384 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:58.504042 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:38:58.504384 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:58.504105 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:38:59.503999 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:38:59.503971 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:38:59.504386 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:38:59.504110 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:00.503971 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:00.503942 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:00.504178 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:00.504034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:00.504178 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:00.504134 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:00.504482 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:00.504237 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:01.503741 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:01.503706 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:01.503973 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:01.503842 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:02.184494 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:02.184460 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:02.184950 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.184560 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:39:02.184950 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.184631 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret podName:9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:18.184615986 +0000 UTC m=+34.035546798 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret") pod "global-pull-secret-syncer-22rjz" (UID: "9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:39:02.285487 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:02.285429 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:02.285634 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.285596 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:39:02.285702 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.285679 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:18.285662601 +0000 UTC m=+34.136593418 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:39:02.386212 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:02.386167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:02.386407 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.386326 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:39:02.386407 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.386354 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:39:02.386407 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.386364 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thgnz for pod openshift-network-diagnostics/network-check-target-w678h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:39:02.386555 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.386426 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz podName:86dc7fb6-9951-46aa-be15-d2037492adca nodeName:}" failed. No retries permitted until 2026-06-15 01:39:18.38640874 +0000 UTC m=+34.237339559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-thgnz" (UniqueName: "kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz") pod "network-check-target-w678h" (UID: "86dc7fb6-9951-46aa-be15-d2037492adca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:39:02.504212 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:02.504137 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:02.504368 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.504260 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:02.504368 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:02.504331 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:02.504474 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:02.504408 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:03.504482 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:03.504455 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:03.504967 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:03.504584 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:04.504698 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:04.504658 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:04.505167 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:04.504766 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:04.505167 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:04.504775 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:04.505167 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:04.504906 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:05.504406 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:05.504342 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:05.504543 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:05.504444 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:06.503888 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.503586 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:06.504620 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.503655 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:06.504620 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:06.503973 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:06.504620 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:06.504024 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:06.640336 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.640301 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zgndx" event={"ID":"92dabc05-371d-4409-9ed1-945647845c72","Type":"ContainerStarted","Data":"d54156dd5607eae361e9e2d4e014472347706c2681d7057174f29cde95d333df"} Jun 15 01:39:06.642119 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.642087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" event={"ID":"77b085cd-9ee6-43d9-9009-36d8d079e467","Type":"ContainerStarted","Data":"ed83698adaf9784abe7cd54ea40f8ce008cff6d6a85a00dc8b4fc1a4a0b3836d"} Jun 15 01:39:06.643764 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.643737 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t8rgh" event={"ID":"7f2a2af3-7443-492d-a735-04f9c1e8961b","Type":"ContainerStarted","Data":"2c6a04bdadae20ddf594f3ecfe4dd152d9d6dd78f952c8755fdda32f58052cb0"} Jun 15 01:39:06.645521 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.645496 2574 generic.go:356] "Generic (PLEG): container finished" podID="4d20763a-906f-4ae3-ab71-457ec9b2a1b2" containerID="8ebe47b27cece1192b2757fba0ec020bd5feb7574cbcbf0757d851cf8e954c16" exitCode=0 Jun 15 01:39:06.645674 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.645576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerDied","Data":"8ebe47b27cece1192b2757fba0ec020bd5feb7574cbcbf0757d851cf8e954c16"} Jun 15 01:39:06.647167 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.647146 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w5pfh" event={"ID":"758f4a15-f524-48f4-a92e-555379652796","Type":"ContainerStarted","Data":"afc4c3b402ee64dc40cddadad5f227bf61b1cd9396c3df0a096ee903c3d6e4b9"} Jun 15 01:39:06.648895 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.648875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-szbvk" event={"ID":"3d585f82-4710-439c-8813-91aea3d6e929","Type":"ContainerStarted","Data":"f5b20b828d6726480d9531170d5786e184f65bf58b59c4947dc648c24109f7f9"} Jun 15 01:39:06.652281 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.652265 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:39:06.652681 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.652653 2574 generic.go:356] "Generic (PLEG): container finished" podID="25e574c2-6beb-402c-b25c-1dc459ffbad5" containerID="7e6ee3d5fbd528bab2da88212389d074e5ce2a9b7692e494c3f25d7b8a99f9bb" exitCode=1 Jun 15 01:39:06.652780 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.652724 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"ffca04167ed77fe4efc6a9e086e5f83894367e3efa2d607bbae7ae37794090c0"} Jun 15 01:39:06.652844 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.652780 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"8d0657ada2772eeb50602f65cc3a3477fb27e952b947affdbaee21aac8d515ad"} Jun 15 01:39:06.652844 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.652824 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"df83e690194195e28729cf3a8f9d7f027cbc892a09fba47ee66f626cd41d31e3"} Jun 15 01:39:06.652932 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.652870 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"ed6c36658811cd4da0c3bd219eaeed4970f04c64dced9f6a848f0684a601b3ff"} Jun 15 01:39:06.652932 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.652919 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerDied","Data":"7e6ee3d5fbd528bab2da88212389d074e5ce2a9b7692e494c3f25d7b8a99f9bb"} Jun 15 01:39:06.653017 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.652965 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"7d219af025c70e8ab19bd15de83af19d8a696402b9f5e2dfccaa304fc99b1b70"} Jun 15 01:39:06.654143 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.654122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j6jqq" event={"ID":"7d25f315-6493-497b-b5b5-0e615401d7ee","Type":"ContainerStarted","Data":"3c46e2bde5dab428072f1e25fe10ca094705dab627aad2a0106575f8095c4ec9"} Jun 15 01:39:06.654963 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.654924 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zgndx" podStartSLOduration=8.133734154 podStartE2EDuration="22.654913527s" totalImagesPullingTime="14.521179373s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:06.654626858 +0000 UTC m=+22.505557693" watchObservedRunningTime="2026-06-15 01:39:06.654913527 +0000 UTC m=+22.505844361" Jun 15 01:39:06.655203 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.655183 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-94.ec2.internal" podStartSLOduration=21.65517562 podStartE2EDuration="21.65517562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:38:48.612054874 +0000 UTC m=+4.462985709" watchObservedRunningTime="2026-06-15 01:39:06.65517562 +0000 UTC m=+22.506106453" Jun 15 01:39:06.688302 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.688268 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-szbvk" podStartSLOduration=4.091700197 podStartE2EDuration="22.688255796s" totalImagesPullingTime="18.596555599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:06.687589216 +0000 UTC m=+22.538520100" watchObservedRunningTime="2026-06-15 01:39:06.688255796 +0000 UTC m=+22.539186629" Jun 15 01:39:06.688389 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.688350 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t8rgh" podStartSLOduration=4.121917892 podStartE2EDuration="22.688344939s" totalImagesPullingTime="18.566427047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:06.67081875 +0000 UTC m=+22.521749628" watchObservedRunningTime="2026-06-15 01:39:06.688344939 +0000 UTC m=+22.539275773" Jun 15 01:39:06.703409 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:06.703373 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-j6jqq" podStartSLOduration=3.641984238 podStartE2EDuration="22.703334004s" totalImagesPullingTime="19.061349766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:06.703097441 +0000 UTC m=+22.554028289" watchObservedRunningTime="2026-06-15 01:39:06.703334004 +0000 UTC m=+22.554264840" Jun 15 01:39:07.211857 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.211685 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 01:39:07.503620 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.503596 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:07.503817 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:07.503760 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:07.519867 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.519728 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T01:39:07.211855305Z","UUID":"441fb948-75d6-4467-a89f-e681964ef4a2","Handler":null,"Name":"","Endpoint":""} Jun 15 01:39:07.521274 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.521253 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 01:39:07.521405 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.521294 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 01:39:07.659148 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.659110 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" event={"ID":"77b085cd-9ee6-43d9-9009-36d8d079e467","Type":"ContainerStarted","Data":"c48760197d5b99f05bef12655c74e1cae12163af423499a11ab33dfad2a306cc"} Jun 15 01:39:07.660954 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.660900 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sczlg" event={"ID":"6f925710-db9f-4abf-813e-32b25b5c0483","Type":"ContainerStarted","Data":"540fdfd986e064c4d592211eeaf28ce3787350ac8fdb8d9372ae6d6f7c1dca24"} Jun 15 01:39:07.675148 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.675104 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w5pfh" podStartSLOduration=5.082628653 podStartE2EDuration="23.675086868s" totalImagesPullingTime="18.592458215s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:06.73481124 +0000 UTC m=+22.585742086" watchObservedRunningTime="2026-06-15 01:39:07.675086868 +0000 UTC m=+23.526017703" Jun 15 01:39:07.675489 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:07.675463 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sczlg" podStartSLOduration=5.0901921 podStartE2EDuration="23.67545629s" totalImagesPullingTime="18.58526419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:07.674704563 +0000 UTC m=+23.525635424" watchObservedRunningTime="2026-06-15 01:39:07.67545629 +0000 UTC m=+23.526387125" Jun 15 01:39:08.505137 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:08.504552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:08.505137 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:08.504581 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:08.505137 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:08.504705 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:08.505137 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:08.505096 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:08.666837 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:08.666808 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:39:08.667518 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:08.667283 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"7c2d8d2e95af02fdea1c3f601bdd83a93ebced4df3180cfb316f46c0b0f65304"} Jun 15 01:39:08.669556 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:08.669529 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" event={"ID":"77b085cd-9ee6-43d9-9009-36d8d079e467","Type":"ContainerStarted","Data":"7b56d6a0a04e4a62c2e5ff43984bbcfcacaec673d50f85fae96aa88e22496d94"} Jun 15 01:39:08.684690 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:08.684653 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-btvzq" podStartSLOduration=3.978366081 podStartE2EDuration="24.684624648s" totalImagesPullingTime="20.706258567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:08.683930277 +0000 UTC m=+24.534861111" watchObservedRunningTime="2026-06-15 01:39:08.684624648 +0000 UTC m=+24.535555483" Jun 15 01:39:09.290300 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:09.290259 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:39:09.503739 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:09.503714 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:09.503906 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:09.503813 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:10.227880 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:10.227848 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:39:10.228492 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:10.228475 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:39:10.503957 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:10.503855 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:10.504093 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:10.503981 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:10.504093 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:10.504020 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:10.504216 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:10.504093 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:10.674361 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:10.674338 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zgndx" Jun 15 01:39:11.504315 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.504147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:11.504797 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:11.504384 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:11.677766 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.677737 2574 generic.go:356] "Generic (PLEG): container finished" podID="4d20763a-906f-4ae3-ab71-457ec9b2a1b2" containerID="14fab363b27e48e320b4efe877a49d37adb44fbf56d673822530c8b5c298c066" exitCode=0 Jun 15 01:39:11.677940 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.677825 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerDied","Data":"14fab363b27e48e320b4efe877a49d37adb44fbf56d673822530c8b5c298c066"} Jun 15 01:39:11.681335 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.681313 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:39:11.681754 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.681732 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"795a6f43c12d47681620808ec25d9c2f2161aa1317b42cafdedc7f7a1ea317fd"} Jun 15 01:39:11.682065 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.681949 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:39:11.682065 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.682019 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:39:11.682065 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.682067 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:39:11.682246 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.682163 2574 scope.go:117] "RemoveContainer" containerID="7e6ee3d5fbd528bab2da88212389d074e5ce2a9b7692e494c3f25d7b8a99f9bb" Jun 15 01:39:11.697841 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.697821 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:39:11.698534 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:11.698497 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:39:12.504012 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.503984 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:12.504176 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.503982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:12.504176 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:12.504082 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:12.504278 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:12.504186 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:12.688572 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.688443 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:39:12.689009 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.688984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" event={"ID":"25e574c2-6beb-402c-b25c-1dc459ffbad5","Type":"ContainerStarted","Data":"2136c66934a3e82318b3f19731df40e353c879c545d9f52cbcdf01303830d789"} Jun 15 01:39:12.701916 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.701895 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22rjz"] Jun 15 01:39:12.702026 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.701981 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:12.702105 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:12.702084 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:12.705298 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.705267 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w678h"] Jun 15 01:39:12.705403 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.705319 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ddm5s"] Jun 15 01:39:12.705403 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.705392 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:12.705539 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:12.705516 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:12.705605 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.705549 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:12.705733 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:12.705711 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:12.713935 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:12.713794 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" podStartSLOduration=10.106268232 podStartE2EDuration="28.713776975s" totalImagesPullingTime="18.607508743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:12.712884163 +0000 UTC m=+28.563815018" watchObservedRunningTime="2026-06-15 01:39:12.713776975 +0000 UTC m=+28.564707810" Jun 15 01:39:13.692800 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:13.692769 2574 generic.go:356] "Generic (PLEG): container finished" podID="4d20763a-906f-4ae3-ab71-457ec9b2a1b2" containerID="d5e8e560f6a8e2ea312a113b030d097f2f0d2723bcd42b134e78b21efcdcd372" exitCode=0 Jun 15 01:39:13.693456 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:13.692856 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerDied","Data":"d5e8e560f6a8e2ea312a113b030d097f2f0d2723bcd42b134e78b21efcdcd372"} Jun 15 01:39:14.505312 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:14.505280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:14.505499 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:14.505391 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:14.505499 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:14.505395 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:14.505614 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:14.505518 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:14.505614 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:14.505554 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:14.505733 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:14.505687 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:14.697508 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:14.697482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerStarted","Data":"e57ff0b0b0c2bd839acd32d6abb29e29dd4b7952745b5fd83403242e099e9a02"} Jun 15 01:39:15.701781 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:15.701707 2574 generic.go:356] "Generic (PLEG): container finished" podID="4d20763a-906f-4ae3-ab71-457ec9b2a1b2" containerID="e57ff0b0b0c2bd839acd32d6abb29e29dd4b7952745b5fd83403242e099e9a02" exitCode=0 Jun 15 01:39:15.701781 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:15.701753 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerDied","Data":"e57ff0b0b0c2bd839acd32d6abb29e29dd4b7952745b5fd83403242e099e9a02"} Jun 15 01:39:16.503770 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:16.503735 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:16.503770 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:16.503735 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:16.503991 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:16.503877 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:16.503991 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:16.503878 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:16.503991 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:16.503967 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:16.504130 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:16.504064 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:18.208099 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:18.207863 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:18.208552 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.208002 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:39:18.208552 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.208193 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret podName:9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:50.208171809 +0000 UTC m=+66.059102636 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret") pod "global-pull-secret-syncer-22rjz" (UID: "9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:39:18.309093 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:18.309058 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:18.309244 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.309205 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:39:18.309310 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.309267 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:39:50.30924946 +0000 UTC m=+66.160180275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:39:18.409958 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:18.409925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:18.410139 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.410090 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:39:18.410139 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.410111 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:39:18.410139 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.410121 2574 projected.go:196] Error preparing data for projected volume kube-api-access-thgnz for pod openshift-network-diagnostics/network-check-target-w678h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:39:18.410307 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.410167 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz podName:86dc7fb6-9951-46aa-be15-d2037492adca nodeName:}" failed. No retries permitted until 2026-06-15 01:39:50.410154437 +0000 UTC m=+66.261085253 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-thgnz" (UniqueName: "kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz") pod "network-check-target-w678h" (UID: "86dc7fb6-9951-46aa-be15-d2037492adca") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:39:18.504005 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:18.503893 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:18.504005 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:18.503895 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:18.504224 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:18.504035 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:18.504224 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.504028 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-22rjz" podUID="9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3" Jun 15 01:39:18.504224 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.504127 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-w678h" podUID="86dc7fb6-9951-46aa-be15-d2037492adca" Jun 15 01:39:18.504224 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:18.504206 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:39:18.958899 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:18.958869 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-94.ec2.internal" event="NodeReady" Jun 15 01:39:18.959084 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:18.959011 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 01:39:19.000867 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.000827 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-krlqp"] Jun 15 01:39:19.003964 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.003941 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-p66kz"] Jun 15 01:39:19.004088 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.004057 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.005873 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.005850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p66kz" Jun 15 01:39:19.006015 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.005933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 01:39:19.006015 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.005956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55pqm\"" Jun 15 01:39:19.006479 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.006460 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 01:39:19.007866 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.007795 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 01:39:19.007866 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.007855 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 01:39:19.008006 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.007930 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 01:39:19.008058 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.007933 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8gwn9\"" Jun 15 01:39:19.013751 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.013698 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p66kz"] Jun 15 01:39:19.014477 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.014449 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-krlqp"] Jun 15 01:39:19.115406 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.115376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-config-volume\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.115564 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.115428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.115564 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.115505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-tmp-dir\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.115564 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.115553 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzxkc\" (UniqueName: \"kubernetes.io/projected/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-kube-api-access-gzxkc\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.115724 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.115575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbacee2-636d-4e29-a8fe-f6470080f24c-cert\") pod \"ingress-canary-p66kz\" (UID: \"8cbacee2-636d-4e29-a8fe-f6470080f24c\") " pod="openshift-ingress-canary/ingress-canary-p66kz" Jun 15 01:39:19.115724 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.115598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzsm7\" (UniqueName: \"kubernetes.io/projected/8cbacee2-636d-4e29-a8fe-f6470080f24c-kube-api-access-bzsm7\") pod \"ingress-canary-p66kz\" (UID: \"8cbacee2-636d-4e29-a8fe-f6470080f24c\") " pod="openshift-ingress-canary/ingress-canary-p66kz" Jun 15 01:39:19.216766 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.216695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.216766 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.216737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-tmp-dir\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.216766 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.216761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzxkc\" (UniqueName: \"kubernetes.io/projected/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-kube-api-access-gzxkc\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.217201 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.216779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbacee2-636d-4e29-a8fe-f6470080f24c-cert\") pod \"ingress-canary-p66kz\" (UID: \"8cbacee2-636d-4e29-a8fe-f6470080f24c\") " pod="openshift-ingress-canary/ingress-canary-p66kz" Jun 15 01:39:19.217201 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.216801 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzsm7\" (UniqueName: \"kubernetes.io/projected/8cbacee2-636d-4e29-a8fe-f6470080f24c-kube-api-access-bzsm7\") pod \"ingress-canary-p66kz\" (UID: \"8cbacee2-636d-4e29-a8fe-f6470080f24c\") " pod="openshift-ingress-canary/ingress-canary-p66kz" Jun 15 01:39:19.217201 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.216864 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-config-volume\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.217201 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:19.216863 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:19.217201 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:19.216959 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:39:19.716940207 +0000 UTC m=+35.567871026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:39:19.217201 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.217066 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-tmp-dir\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.217501 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.217455 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-config-volume\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.221548 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.221523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cbacee2-636d-4e29-a8fe-f6470080f24c-cert\") pod \"ingress-canary-p66kz\" (UID: \"8cbacee2-636d-4e29-a8fe-f6470080f24c\") " pod="openshift-ingress-canary/ingress-canary-p66kz" Jun 15 01:39:19.224349 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.224330 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzsm7\" (UniqueName: \"kubernetes.io/projected/8cbacee2-636d-4e29-a8fe-f6470080f24c-kube-api-access-bzsm7\") pod \"ingress-canary-p66kz\" (UID: \"8cbacee2-636d-4e29-a8fe-f6470080f24c\") " pod="openshift-ingress-canary/ingress-canary-p66kz" Jun 15 01:39:19.224488 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.224468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzxkc\" (UniqueName: \"kubernetes.io/projected/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-kube-api-access-gzxkc\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.326198 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.326169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-p66kz" Jun 15 01:39:19.670295 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.670265 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-p66kz"] Jun 15 01:39:19.675611 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:39:19.675582 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cbacee2_636d_4e29_a8fe_f6470080f24c.slice/crio-3df1b7066b7a3577e1babef525229b24b7d74ee9885f2f76380d1b942e94272e WatchSource:0}: Error finding container 3df1b7066b7a3577e1babef525229b24b7d74ee9885f2f76380d1b942e94272e: Status 404 returned error can't find the container with id 3df1b7066b7a3577e1babef525229b24b7d74ee9885f2f76380d1b942e94272e Jun 15 01:39:19.714319 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.714275 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerStarted","Data":"e50a781d0e9e28b2888c8162f3aebf59c49048af81675c295f1187039523a9cf"} Jun 15 01:39:19.715385 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.715357 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p66kz" event={"ID":"8cbacee2-636d-4e29-a8fe-f6470080f24c","Type":"ContainerStarted","Data":"3df1b7066b7a3577e1babef525229b24b7d74ee9885f2f76380d1b942e94272e"} Jun 15 01:39:19.721035 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:19.721014 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:19.721125 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:19.721115 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:19.721171 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:19.721161 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:39:20.721148533 +0000 UTC m=+36.572079345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:39:20.504108 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.503874 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:20.504528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.503874 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:20.504528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.503921 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:20.506963 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.506939 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-46p56\"" Jun 15 01:39:20.507108 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.506970 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 01:39:20.507108 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.506976 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 01:39:20.507108 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.507035 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 01:39:20.507108 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.506939 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 01:39:20.507108 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.506947 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkjfs\"" Jun 15 01:39:20.721369 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.721338 2574 generic.go:356] "Generic (PLEG): container finished" podID="4d20763a-906f-4ae3-ab71-457ec9b2a1b2" containerID="e50a781d0e9e28b2888c8162f3aebf59c49048af81675c295f1187039523a9cf" exitCode=0 Jun 15 01:39:20.721516 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.721403 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerDied","Data":"e50a781d0e9e28b2888c8162f3aebf59c49048af81675c295f1187039523a9cf"} Jun 15 01:39:20.726592 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:20.726571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:20.726719 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:20.726707 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:20.726775 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:20.726767 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:39:22.726750364 +0000 UTC m=+38.577681175 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:39:21.727121 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:21.727090 2574 generic.go:356] "Generic (PLEG): container finished" podID="4d20763a-906f-4ae3-ab71-457ec9b2a1b2" containerID="41822ac93492bc4533ab824915cc738143558b7eb0f4bc97d1cd5a2255be61ae" exitCode=0 Jun 15 01:39:21.727777 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:21.727159 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerDied","Data":"41822ac93492bc4533ab824915cc738143558b7eb0f4bc97d1cd5a2255be61ae"} Jun 15 01:39:21.728746 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:21.728720 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-p66kz" event={"ID":"8cbacee2-636d-4e29-a8fe-f6470080f24c","Type":"ContainerStarted","Data":"c2f954a784511554fe0dfa2f63094eebf8713ca0c7ef5ecf9852a8306158100d"} Jun 15 01:39:21.761505 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:21.761453 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-p66kz" podStartSLOduration=2.34808233 podStartE2EDuration="3.76143262s" totalImagesPullingTime="1.41335029s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:21.760347755 +0000 UTC m=+37.611278624" watchObservedRunningTime="2026-06-15 01:39:21.76143262 +0000 UTC m=+37.612363454" Jun 15 01:39:22.734184 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:22.734147 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bndl9" event={"ID":"4d20763a-906f-4ae3-ab71-457ec9b2a1b2","Type":"ContainerStarted","Data":"90b5aebbb434e4b1d1667e35ed533c9e757fbdba83df8e936871dc9ed65b385c"} Jun 15 01:39:22.741200 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:22.741179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:22.741297 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:22.741283 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:22.741343 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:22.741334 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:39:26.741321989 +0000 UTC m=+42.592252804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:39:22.754347 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:22.754300 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bndl9" podStartSLOduration=10.372115728 podStartE2EDuration="38.754272973s" totalImagesPullingTime="28.382157245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:22.753359811 +0000 UTC m=+38.604290646" watchObservedRunningTime="2026-06-15 01:39:22.754272973 +0000 UTC m=+38.605203807" Jun 15 01:39:26.766798 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:26.766761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:26.767155 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:26.766893 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:26.767155 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:26.766944 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:39:34.76693075 +0000 UTC m=+50.617861562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:39:34.817862 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:34.817831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:34.818352 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:34.817927 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:34.818352 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:34.817974 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:39:50.817961216 +0000 UTC m=+66.668892029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:39:40.845095 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.845064 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj"] Jun 15 01:39:40.847898 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.847873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.849697 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.849672 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 15 01:39:40.849911 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.849896 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 15 01:39:40.850032 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.850010 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 15 01:39:40.850427 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.850406 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 15 01:39:40.850565 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.850549 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 15 01:39:40.850675 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.850596 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 15 01:39:40.850785 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.850771 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 15 01:39:40.858941 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.858919 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj"] Jun 15 01:39:40.859091 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.859071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.859161 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.859098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.859161 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.859117 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-hub\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.859241 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.859207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hxx\" (UniqueName: \"kubernetes.io/projected/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-kube-api-access-p4hxx\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.859295 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.859261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.859337 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.859291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-ca\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.960434 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.960407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.960434 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.960435 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.960616 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.960456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-hub\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.960616 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.960492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hxx\" (UniqueName: \"kubernetes.io/projected/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-kube-api-access-p4hxx\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.960738 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.960662 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.960738 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.960703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-ca\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.961279 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.961253 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.963971 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.963944 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.964078 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.963948 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.964078 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.964018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-ca\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.964078 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.964039 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-hub\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:40.967409 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:40.967388 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hxx\" (UniqueName: \"kubernetes.io/projected/62e0037b-1f5b-4f1c-9a2a-e91b55a47fec-kube-api-access-p4hxx\") pod \"cluster-proxy-proxy-agent-7885dbbffc-m7cvj\" (UID: \"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:41.170653 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:41.170550 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:39:41.288672 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:41.288597 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj"] Jun 15 01:39:41.292885 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:39:41.292862 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62e0037b_1f5b_4f1c_9a2a_e91b55a47fec.slice/crio-a5fa924037646e2fa2f9896eb7f07a54fd85d92ffb567ffa51e2cecde583545f WatchSource:0}: Error finding container a5fa924037646e2fa2f9896eb7f07a54fd85d92ffb567ffa51e2cecde583545f: Status 404 returned error can't find the container with id a5fa924037646e2fa2f9896eb7f07a54fd85d92ffb567ffa51e2cecde583545f Jun 15 01:39:41.777993 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:41.777963 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" event={"ID":"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec","Type":"ContainerStarted","Data":"a5fa924037646e2fa2f9896eb7f07a54fd85d92ffb567ffa51e2cecde583545f"} Jun 15 01:39:43.704328 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:43.704299 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4pcf7" Jun 15 01:39:45.790803 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:45.790777 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" event={"ID":"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec","Type":"ContainerStarted","Data":"29725f996ee9ebc124eaae6d9f78a279fdb1d54f89a151eb7f1c45e564ec3f01"} Jun 15 01:39:45.791166 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:45.790814 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" event={"ID":"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec","Type":"ContainerStarted","Data":"101fe07d1fe8332c966c94cb4aa5199bfdedc4610071dbd447b5a59b3fec5c8c"} Jun 15 01:39:45.791166 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:45.790826 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" event={"ID":"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec","Type":"ContainerStarted","Data":"241c9f86eaa6cc7fdc077c4a070fff7d47da81f251cd48f407ab52b5db65eac7"} Jun 15 01:39:45.806688 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:45.806633 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" podStartSLOduration=1.741319804 podStartE2EDuration="5.806615946s" totalImagesPullingTime="4.065296142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:45.805904206 +0000 UTC m=+61.656835042" watchObservedRunningTime="2026-06-15 01:39:45.806615946 +0000 UTC m=+61.657546778" Jun 15 01:39:50.225729 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.225679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:50.228245 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.228225 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 01:39:50.238820 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.238792 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3-original-pull-secret\") pod \"global-pull-secret-syncer-22rjz\" (UID: \"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3\") " pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:50.326158 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.326134 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:39:50.328313 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.328296 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 01:39:50.336777 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:50.336765 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 01:39:50.336894 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:50.336810 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:40:54.336796804 +0000 UTC m=+130.187727617 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : secret "metrics-daemon-secret" not found Jun 15 01:39:50.427030 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.427002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:50.429025 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.429010 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 01:39:50.439128 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.439110 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 01:39:50.449649 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.449623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thgnz\" (UniqueName: \"kubernetes.io/projected/86dc7fb6-9951-46aa-be15-d2037492adca-kube-api-access-thgnz\") pod \"network-check-target-w678h\" (UID: \"86dc7fb6-9951-46aa-be15-d2037492adca\") " pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:50.518330 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.518255 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-22rjz" Jun 15 01:39:50.525129 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.525112 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hkjfs\"" Jun 15 01:39:50.533826 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.533808 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:50.664170 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.664144 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-22rjz"] Jun 15 01:39:50.667466 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:39:50.667442 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d10b3c3_904f_4cc5_b6c8_ccfb50e8cbc3.slice/crio-4df1b1ad31207a3816c34388fe4effe928f357e303920446f2cf7d04589a1e7a WatchSource:0}: Error finding container 4df1b1ad31207a3816c34388fe4effe928f357e303920446f2cf7d04589a1e7a: Status 404 returned error can't find the container with id 4df1b1ad31207a3816c34388fe4effe928f357e303920446f2cf7d04589a1e7a Jun 15 01:39:50.675838 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.675816 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-w678h"] Jun 15 01:39:50.679171 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:39:50.679150 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dc7fb6_9951_46aa_be15_d2037492adca.slice/crio-b071d41f6d19a5b892edb2ed944e0f93312cc6e75a9e348e6e146a5bf671b27e WatchSource:0}: Error finding container b071d41f6d19a5b892edb2ed944e0f93312cc6e75a9e348e6e146a5bf671b27e: Status 404 returned error can't find the container with id b071d41f6d19a5b892edb2ed944e0f93312cc6e75a9e348e6e146a5bf671b27e Jun 15 01:39:50.803023 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.802968 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22rjz" event={"ID":"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3","Type":"ContainerStarted","Data":"4df1b1ad31207a3816c34388fe4effe928f357e303920446f2cf7d04589a1e7a"} Jun 15 01:39:50.803973 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.803951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w678h" event={"ID":"86dc7fb6-9951-46aa-be15-d2037492adca","Type":"ContainerStarted","Data":"b071d41f6d19a5b892edb2ed944e0f93312cc6e75a9e348e6e146a5bf671b27e"} Jun 15 01:39:50.829623 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:50.829597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:39:50.829744 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:50.829730 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:39:50.829786 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:39:50.829777 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:40:22.82976349 +0000 UTC m=+98.680694301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:39:55.824594 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:55.824551 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-22rjz" event={"ID":"9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3","Type":"ContainerStarted","Data":"36128574a112b0687cd4e98d743b049f7be2f8583e6fe2719833f5e52bf9e425"} Jun 15 01:39:55.825995 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:55.825964 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-w678h" event={"ID":"86dc7fb6-9951-46aa-be15-d2037492adca","Type":"ContainerStarted","Data":"8e694f8c144c4fd2c08f0f6187491ae1187bb2d793fb07b58832c34a532923da"} Jun 15 01:39:55.826130 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:55.826101 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:39:55.838250 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:55.838208 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-22rjz" podStartSLOduration=67.489115039 podStartE2EDuration="1m11.838196107s" totalImagesPullingTime="4.349081068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:55.837311277 +0000 UTC m=+71.688242111" watchObservedRunningTime="2026-06-15 01:39:55.838196107 +0000 UTC m=+71.689126941" Jun 15 01:39:55.855391 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:39:55.855353 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-w678h" podStartSLOduration=67.521772162 podStartE2EDuration="1m11.855341424s" totalImagesPullingTime="4.333569262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:39:55.855112846 +0000 UTC m=+71.706043705" watchObservedRunningTime="2026-06-15 01:39:55.855341424 +0000 UTC m=+71.706272235" Jun 15 01:40:22.830981 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:40:22.830937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:40:22.831414 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:40:22.831077 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:40:22.831414 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:40:22.831152 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:41:26.831136196 +0000 UTC m=+162.682067009 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:40:26.831559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:40:26.831531 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-w678h" Jun 15 01:40:54.435392 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:40:54.435358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:40:54.435908 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:40:54.435464 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 01:40:54.435908 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:40:54.435524 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs podName:01c71114-88ea-43c9-9b1e-5993cac19357 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:56.435510735 +0000 UTC m=+252.286441548 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs") pod "network-metrics-daemon-ddm5s" (UID: "01c71114-88ea-43c9-9b1e-5993cac19357") : secret "metrics-daemon-secret" not found Jun 15 01:41:22.020743 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:41:22.020704 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-krlqp" podUID="4ba0ff22-7715-4be4-98f0-dd8e2af4625a" Jun 15 01:41:22.069700 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:41:22.069676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-krlqp" Jun 15 01:41:23.528433 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:41:23.528392 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ddm5s" podUID="01c71114-88ea-43c9-9b1e-5993cac19357" Jun 15 01:41:26.840557 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:41:26.840522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:41:26.841093 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:41:26.840701 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 01:41:26.841093 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:41:26.840799 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls podName:4ba0ff22-7715-4be4-98f0-dd8e2af4625a nodeName:}" failed. No retries permitted until 2026-06-15 01:43:28.840776369 +0000 UTC m=+284.691707183 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls") pod "dns-default-krlqp" (UID: "4ba0ff22-7715-4be4-98f0-dd8e2af4625a") : secret "dns-default-metrics-tls" not found Jun 15 01:41:36.504512 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:41:36.504440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:42:00.846123 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.846083 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq"] Jun 15 01:42:00.848300 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.848281 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.850363 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.850330 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 15 01:42:00.850363 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.850354 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 15 01:42:00.850523 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.850374 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-dfp69\"" Jun 15 01:42:00.850961 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.850939 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 15 01:42:00.851066 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.850942 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:42:00.854112 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.854079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-config\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.854196 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.854121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqtp\" (UniqueName: \"kubernetes.io/projected/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-kube-api-access-kgqtp\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.854257 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.854219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.858518 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.858498 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq"] Jun 15 01:42:00.955367 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.955334 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-config\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.955367 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.955372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqtp\" (UniqueName: \"kubernetes.io/projected/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-kube-api-access-kgqtp\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.955550 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.955425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.955946 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.955928 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-config\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.957675 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.957634 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:00.962076 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:00.962052 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqtp\" (UniqueName: \"kubernetes.io/projected/876c6f2c-ddfc-4ba0-9685-a07d11eb52ef-kube-api-access-kgqtp\") pod \"service-ca-operator-7ccbfd59dc-j97cq\" (UID: \"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:01.156338 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:01.156237 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" Jun 15 01:42:01.272634 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:01.272605 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq"] Jun 15 01:42:01.276319 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:01.276291 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876c6f2c_ddfc_4ba0_9685_a07d11eb52ef.slice/crio-b739e56bc430b4491550f13260649e40fc058031e033f5ba550c6d217be34d4d WatchSource:0}: Error finding container b739e56bc430b4491550f13260649e40fc058031e033f5ba550c6d217be34d4d: Status 404 returned error can't find the container with id b739e56bc430b4491550f13260649e40fc058031e033f5ba550c6d217be34d4d Jun 15 01:42:02.178115 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:02.178034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" event={"ID":"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef","Type":"ContainerStarted","Data":"b739e56bc430b4491550f13260649e40fc058031e033f5ba550c6d217be34d4d"} Jun 15 01:42:04.185399 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:04.185360 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" event={"ID":"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef","Type":"ContainerStarted","Data":"ae4377c3b738c95348dddfe9aec97125ebe33e711fa82736fe431b22aec51ec3"} Jun 15 01:42:04.199529 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:04.199485 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" podStartSLOduration=2.265555716 podStartE2EDuration="4.199470954s" totalImagesPullingTime="1.933915238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:04.198693536 +0000 UTC m=+200.049624371" watchObservedRunningTime="2026-06-15 01:42:04.199470954 +0000 UTC m=+200.050401787" Jun 15 01:42:05.226214 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.226181 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lh86z"] Jun 15 01:42:05.228487 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.228464 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.230622 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.230599 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 01:42:05.230743 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.230600 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 01:42:05.230743 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.230600 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m4nht\"" Jun 15 01:42:05.230743 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.230607 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 01:42:05.231026 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.231013 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 01:42:05.238018 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.237995 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lh86z"] Jun 15 01:42:05.283605 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.283583 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66p5r\" (UniqueName: \"kubernetes.io/projected/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-api-access-66p5r\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.283703 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.283622 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-crio-socket\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.283703 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.283657 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.283817 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.283777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-data-volume\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.283907 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.283891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.384858 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.384835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.384932 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.384867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66p5r\" (UniqueName: \"kubernetes.io/projected/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-api-access-66p5r\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.384932 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.384887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-crio-socket\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.384932 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.384902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.385047 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.384936 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-data-volume\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.385047 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:05.384968 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:05.385047 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.384981 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-crio-socket\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.385047 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:05.385010 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.385047 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:05.385031 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:05.885012887 +0000 UTC m=+201.735943707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : configmap "kube-rbac-proxy" not found Jun 15 01:42:05.385223 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:05.385075 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:05.885056711 +0000 UTC m=+201.735987534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.385261 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.385247 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-data-volume\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.395022 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.394999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-66p5r\" (UniqueName: \"kubernetes.io/projected/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-api-access-66p5r\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.888732 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.888707 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.888864 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:05.888745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:05.888864 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:05.888829 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:05.888864 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:05.888854 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:05.888962 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:05.888891 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:06.88887463 +0000 UTC m=+202.739805448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : configmap "kube-rbac-proxy" not found Jun 15 01:42:05.888962 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:05.888904 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:06.888898443 +0000 UTC m=+202.739829255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:06.814153 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.814122 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-7qpf6"] Jun 15 01:42:06.816760 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.816731 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:06.819430 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.819404 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-r8p6k\"" Jun 15 01:42:06.819560 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.819446 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 15 01:42:06.819869 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.819848 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 15 01:42:06.819980 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.819913 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 15 01:42:06.820083 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.820068 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 15 01:42:06.823739 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.823717 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-7qpf6"] Jun 15 01:42:06.894893 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.894876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:06.895009 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.894908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw72r\" (UniqueName: \"kubernetes.io/projected/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-kube-api-access-rw72r\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:06.895009 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.894937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-signing-key\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:06.895009 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.894982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-signing-cabundle\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:06.895120 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:06.895037 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:06.895120 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.895050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:06.895120 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:06.895095 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.895076007 +0000 UTC m=+204.746006819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:06.895120 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:06.895106 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:06.895251 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:06.895162 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:08.895149887 +0000 UTC m=+204.746080698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : configmap "kube-rbac-proxy" not found Jun 15 01:42:06.996134 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.996110 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-signing-cabundle\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:06.996241 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.996189 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw72r\" (UniqueName: \"kubernetes.io/projected/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-kube-api-access-rw72r\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:06.996241 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.996209 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-signing-key\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:06.996759 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.996739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-signing-cabundle\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:06.998508 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:06.998489 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-signing-key\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:07.003997 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:07.003978 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw72r\" (UniqueName: \"kubernetes.io/projected/e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9-kube-api-access-rw72r\") pod \"service-ca-7b994bc59-7qpf6\" (UID: \"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9\") " pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:07.128069 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:07.128052 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" Jun 15 01:42:07.246387 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:07.246360 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-7qpf6"] Jun 15 01:42:07.249308 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:07.249284 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a9f3ba_91b0_4f2c_b43a_69fb21eca2c9.slice/crio-e61ee5451c8f352296e1fe7306cbd6362c15ffcb2eefefe8a03036b0c3731acd WatchSource:0}: Error finding container e61ee5451c8f352296e1fe7306cbd6362c15ffcb2eefefe8a03036b0c3731acd: Status 404 returned error can't find the container with id e61ee5451c8f352296e1fe7306cbd6362c15ffcb2eefefe8a03036b0c3731acd Jun 15 01:42:08.198192 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:08.198160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" event={"ID":"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9","Type":"ContainerStarted","Data":"d13f566100f6879d9ba8946f79906c2681ac28a63af9f4cc0d6944ba9e60bb0d"} Jun 15 01:42:08.198699 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:08.198206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" event={"ID":"e5a9f3ba-91b0-4f2c-b43a-69fb21eca2c9","Type":"ContainerStarted","Data":"e61ee5451c8f352296e1fe7306cbd6362c15ffcb2eefefe8a03036b0c3731acd"} Jun 15 01:42:08.213144 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:08.213094 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-7qpf6" podStartSLOduration=2.213080243 podStartE2EDuration="2.213080243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:08.212897151 +0000 UTC m=+204.063827983" watchObservedRunningTime="2026-06-15 01:42:08.213080243 +0000 UTC m=+204.064011076" Jun 15 01:42:08.308754 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:08.308736 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t8rgh_7f2a2af3-7443-492d-a735-04f9c1e8961b/dns-node-resolver/0.log" Jun 15 01:42:08.908493 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:08.908470 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5pfh_758f4a15-f524-48f4-a92e-555379652796/node-ca/0.log" Jun 15 01:42:08.912739 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:08.912719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:08.912823 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:08.912779 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:08.912875 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:08.912835 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:08.912926 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:08.912873 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:08.912926 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:08.912880 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:12.912869612 +0000 UTC m=+208.763800424 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : configmap "kube-rbac-proxy" not found Jun 15 01:42:08.913010 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:08.912939 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:12.912922599 +0000 UTC m=+208.763853416 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:10.108171 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:10.108144 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p66kz_8cbacee2-636d-4e29-a8fe-f6470080f24c/serve-healthcheck-canary/0.log" Jun 15 01:42:12.944028 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:12.943998 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:12.944382 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:12.944038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:12.944382 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:12.944114 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 01:42:12.944382 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:12.944159 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 01:42:12.944382 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:12.944173 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:20.944158283 +0000 UTC m=+216.795089095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : configmap "kube-rbac-proxy" not found Jun 15 01:42:12.944382 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:12.944196 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls podName:17b13c4f-f941-4c65-a6c9-a4dca2937d2f nodeName:}" failed. No retries permitted until 2026-06-15 01:42:20.944185685 +0000 UTC m=+216.795116497 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lh86z" (UID: "17b13c4f-f941-4c65-a6c9-a4dca2937d2f") : secret "insights-runtime-extractor-tls" not found Jun 15 01:42:21.001497 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:21.001462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:21.001922 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:21.001509 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:21.002002 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:21.001981 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:21.003701 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:21.003682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/17b13c4f-f941-4c65-a6c9-a4dca2937d2f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lh86z\" (UID: \"17b13c4f-f941-4c65-a6c9-a4dca2937d2f\") " pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:21.137092 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:21.137068 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lh86z" Jun 15 01:42:21.259757 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:21.259690 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lh86z"] Jun 15 01:42:21.263213 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:21.263185 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b13c4f_f941_4c65_a6c9_a4dca2937d2f.slice/crio-17a6a664cbaf1f9dd1938f4d4c29df300aa407d1767542384aef066373c88ee5 WatchSource:0}: Error finding container 17a6a664cbaf1f9dd1938f4d4c29df300aa407d1767542384aef066373c88ee5: Status 404 returned error can't find the container with id 17a6a664cbaf1f9dd1938f4d4c29df300aa407d1767542384aef066373c88ee5 Jun 15 01:42:22.241199 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:22.241163 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh86z" event={"ID":"17b13c4f-f941-4c65-a6c9-a4dca2937d2f","Type":"ContainerStarted","Data":"17a6a664cbaf1f9dd1938f4d4c29df300aa407d1767542384aef066373c88ee5"} Jun 15 01:42:25.251286 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:25.251256 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh86z" event={"ID":"17b13c4f-f941-4c65-a6c9-a4dca2937d2f","Type":"ContainerStarted","Data":"bd52cc0c53ea3318047144827a3c193aec099f14259b6224570b7fc455d0e6e9"} Jun 15 01:42:25.251552 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:25.251306 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh86z" event={"ID":"17b13c4f-f941-4c65-a6c9-a4dca2937d2f","Type":"ContainerStarted","Data":"c5914d3bcacb594ca8a641caed1f9dcba196fe9c9573fa1ac6fd32f8e947e221"} Jun 15 01:42:26.692760 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.692714 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-779989c8df-wt6zj"] Jun 15 01:42:26.700696 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.700676 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.703395 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.703370 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 01:42:26.703572 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.703542 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vq2mt\"" Jun 15 01:42:26.704116 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.704091 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 01:42:26.704864 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.704846 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 01:42:26.711899 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.711882 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 01:42:26.716580 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.716557 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779989c8df-wt6zj"] Jun 15 01:42:26.740138 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.740112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05945e40-eea9-4bba-838c-3f19150f0f77-registry-certificates\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.740234 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.740154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05945e40-eea9-4bba-838c-3f19150f0f77-installation-pull-secrets\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.740234 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.740196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05945e40-eea9-4bba-838c-3f19150f0f77-trusted-ca\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.740234 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.740227 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-registry-tls\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.740410 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.740326 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05945e40-eea9-4bba-838c-3f19150f0f77-ca-trust-extracted\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.740410 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.740362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05945e40-eea9-4bba-838c-3f19150f0f77-image-registry-private-configuration\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.740410 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.740392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d4q2\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-kube-api-access-2d4q2\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.740550 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.740422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-bound-sa-token\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841331 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05945e40-eea9-4bba-838c-3f19150f0f77-registry-certificates\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841331 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841334 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05945e40-eea9-4bba-838c-3f19150f0f77-installation-pull-secrets\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841556 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841362 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05945e40-eea9-4bba-838c-3f19150f0f77-trusted-ca\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841556 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-registry-tls\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841556 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05945e40-eea9-4bba-838c-3f19150f0f77-ca-trust-extracted\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841556 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05945e40-eea9-4bba-838c-3f19150f0f77-image-registry-private-configuration\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841556 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d4q2\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-kube-api-access-2d4q2\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841556 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-bound-sa-token\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.841908 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.841761 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/05945e40-eea9-4bba-838c-3f19150f0f77-ca-trust-extracted\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.842363 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.842337 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/05945e40-eea9-4bba-838c-3f19150f0f77-registry-certificates\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.842464 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.842451 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/05945e40-eea9-4bba-838c-3f19150f0f77-trusted-ca\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.844001 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.843971 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/05945e40-eea9-4bba-838c-3f19150f0f77-image-registry-private-configuration\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.844099 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.843975 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-registry-tls\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.844099 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.844061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/05945e40-eea9-4bba-838c-3f19150f0f77-installation-pull-secrets\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.848468 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.848444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d4q2\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-kube-api-access-2d4q2\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:26.849069 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:26.849031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/05945e40-eea9-4bba-838c-3f19150f0f77-bound-sa-token\") pod \"image-registry-779989c8df-wt6zj\" (UID: \"05945e40-eea9-4bba-838c-3f19150f0f77\") " pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:27.011820 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:27.011763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:27.134289 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:27.134254 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779989c8df-wt6zj"] Jun 15 01:42:27.138145 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:27.138116 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05945e40_eea9_4bba_838c_3f19150f0f77.slice/crio-2eddf37f4fb0d79d90c0c7c49569db42a6dae796ba102b0c8aa3089591862298 WatchSource:0}: Error finding container 2eddf37f4fb0d79d90c0c7c49569db42a6dae796ba102b0c8aa3089591862298: Status 404 returned error can't find the container with id 2eddf37f4fb0d79d90c0c7c49569db42a6dae796ba102b0c8aa3089591862298 Jun 15 01:42:27.261568 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:27.261523 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lh86z" event={"ID":"17b13c4f-f941-4c65-a6c9-a4dca2937d2f","Type":"ContainerStarted","Data":"668d21a1b7860aee61e7f5c5ce4aca9cbf5f036400090dae9619fd95dbbe8265"} Jun 15 01:42:27.263252 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:27.263196 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" event={"ID":"05945e40-eea9-4bba-838c-3f19150f0f77","Type":"ContainerStarted","Data":"644bdef049a72f20d6b288030af270d42fc17e4ddfab278c277f803084e10568"} Jun 15 01:42:27.263252 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:27.263235 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" event={"ID":"05945e40-eea9-4bba-838c-3f19150f0f77","Type":"ContainerStarted","Data":"2eddf37f4fb0d79d90c0c7c49569db42a6dae796ba102b0c8aa3089591862298"} Jun 15 01:42:27.263406 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:27.263310 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:42:27.278679 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:27.278608 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lh86z" podStartSLOduration=16.765945304 podStartE2EDuration="22.278595026s" totalImagesPullingTime="5.512649722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:42:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:27.277280819 +0000 UTC m=+223.128211706" watchObservedRunningTime="2026-06-15 01:42:27.278595026 +0000 UTC m=+223.129525859" Jun 15 01:42:27.296154 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:27.296113 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podStartSLOduration=1.2960988580000001 podStartE2EDuration="1.296098858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:27.29546765 +0000 UTC m=+223.146398489" watchObservedRunningTime="2026-06-15 01:42:27.296098858 +0000 UTC m=+223.147029693" Jun 15 01:42:33.498938 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.498901 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-688f675699-grszb"] Jun 15 01:42:33.503577 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.503555 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.505670 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.505628 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 01:42:33.505756 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.505628 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 01:42:33.505756 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.505694 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 01:42:33.506549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.506532 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 01:42:33.506549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.506537 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qz4jw\"" Jun 15 01:42:33.506720 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.506565 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 01:42:33.506720 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.506579 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 01:42:33.506720 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.506579 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 01:42:33.512006 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.511986 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688f675699-grszb"] Jun 15 01:42:33.586055 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.586029 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-service-ca\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.586156 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.586064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9gts\" (UniqueName: \"kubernetes.io/projected/e16387e9-3119-4272-ad3e-613ec5f1083a-kube-api-access-c9gts\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.586156 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.586094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-oauth-serving-cert\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.586156 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.586110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-oauth-config\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.586156 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.586146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-console-config\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.586308 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.586176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-serving-cert\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.686570 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.686541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-oauth-serving-cert\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.686699 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.686573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-oauth-config\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.686699 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.686606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-console-config\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.686699 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.686696 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-serving-cert\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.686863 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.686745 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-service-ca\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.686863 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.686783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9gts\" (UniqueName: \"kubernetes.io/projected/e16387e9-3119-4272-ad3e-613ec5f1083a-kube-api-access-c9gts\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.687223 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.687200 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-oauth-serving-cert\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.687341 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.687316 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-console-config\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.687391 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.687344 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-service-ca\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.689079 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.689048 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-oauth-config\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.689171 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.689142 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-serving-cert\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.693989 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.693966 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9gts\" (UniqueName: \"kubernetes.io/projected/e16387e9-3119-4272-ad3e-613ec5f1083a-kube-api-access-c9gts\") pod \"console-688f675699-grszb\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.812784 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.812730 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:33.939757 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:33.939725 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-688f675699-grszb"] Jun 15 01:42:33.942957 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:33.942932 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16387e9_3119_4272_ad3e_613ec5f1083a.slice/crio-36476f655558210fa1e842d9c6b336f148abed2c1c2c611d6fe1cb21bb6d502c WatchSource:0}: Error finding container 36476f655558210fa1e842d9c6b336f148abed2c1c2c611d6fe1cb21bb6d502c: Status 404 returned error can't find the container with id 36476f655558210fa1e842d9c6b336f148abed2c1c2c611d6fe1cb21bb6d502c Jun 15 01:42:34.284452 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.284421 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688f675699-grszb" event={"ID":"e16387e9-3119-4272-ad3e-613ec5f1083a","Type":"ContainerStarted","Data":"36476f655558210fa1e842d9c6b336f148abed2c1c2c611d6fe1cb21bb6d502c"} Jun 15 01:42:34.458629 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.458598 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m6qx6"] Jun 15 01:42:34.463223 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.463201 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.465825 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.465771 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 01:42:34.466117 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.466094 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 01:42:34.466712 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.466693 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 01:42:34.466799 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.466716 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 01:42:34.466799 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.466724 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 01:42:34.466897 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.466883 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6684v\"" Jun 15 01:42:34.467512 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.466940 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 01:42:34.592324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-root\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.592783 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-wtmp\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.592783 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.592783 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592426 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p7hz\" (UniqueName: \"kubernetes.io/projected/109dda05-f0cf-499a-9625-14ea38804475-kube-api-access-6p7hz\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.592783 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592452 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/109dda05-f0cf-499a-9625-14ea38804475-metrics-client-ca\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.592783 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.592783 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592500 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-tls\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.592783 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-sys\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.592783 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.592555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-textfile\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.694935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-textfile\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695010 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-root\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-wtmp\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p7hz\" (UniqueName: \"kubernetes.io/projected/109dda05-f0cf-499a-9625-14ea38804475-kube-api-access-6p7hz\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/109dda05-f0cf-499a-9625-14ea38804475-metrics-client-ca\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695197 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695225 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-tls\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-sys\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695332 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-sys\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695724 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-textfile\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695781 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-root\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.695894 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-wtmp\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.696762 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/109dda05-f0cf-499a-9625-14ea38804475-metrics-client-ca\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.696795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-accelerators-collector-config\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:34.696890 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 01:42:34.697145 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:42:34.696942 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-tls podName:109dda05-f0cf-499a-9625-14ea38804475 nodeName:}" failed. No retries permitted until 2026-06-15 01:42:35.196925023 +0000 UTC m=+231.047855839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-tls") pod "node-exporter-m6qx6" (UID: "109dda05-f0cf-499a-9625-14ea38804475") : secret "node-exporter-tls" not found Jun 15 01:42:34.702181 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.702152 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:34.704370 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:34.704346 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p7hz\" (UniqueName: \"kubernetes.io/projected/109dda05-f0cf-499a-9625-14ea38804475-kube-api-access-6p7hz\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:35.199358 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:35.199319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-tls\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:35.201929 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:35.201902 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/109dda05-f0cf-499a-9625-14ea38804475-node-exporter-tls\") pod \"node-exporter-m6qx6\" (UID: \"109dda05-f0cf-499a-9625-14ea38804475\") " pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:35.375610 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:35.375579 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m6qx6" Jun 15 01:42:35.388057 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:35.388015 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109dda05_f0cf_499a_9625_14ea38804475.slice/crio-ee7cf3dadaf6e7df002069c860df2a4453c7c8ad8359b695b15ddef7791f50ca WatchSource:0}: Error finding container ee7cf3dadaf6e7df002069c860df2a4453c7c8ad8359b695b15ddef7791f50ca: Status 404 returned error can't find the container with id ee7cf3dadaf6e7df002069c860df2a4453c7c8ad8359b695b15ddef7791f50ca Jun 15 01:42:36.291403 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:36.291369 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6qx6" event={"ID":"109dda05-f0cf-499a-9625-14ea38804475","Type":"ContainerStarted","Data":"ee7cf3dadaf6e7df002069c860df2a4453c7c8ad8359b695b15ddef7791f50ca"} Jun 15 01:42:37.296796 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:37.296764 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6qx6" event={"ID":"109dda05-f0cf-499a-9625-14ea38804475","Type":"ContainerStarted","Data":"1e5c28f1ba0b7691fda379567a8a63fa2f975b494f60ad8d17b3923ab5fae265"} Jun 15 01:42:37.298476 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:37.298453 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688f675699-grszb" event={"ID":"e16387e9-3119-4272-ad3e-613ec5f1083a","Type":"ContainerStarted","Data":"f66725f6ab806d9e291a4220bc4341589af4761e6c694175307c2181ac22d248"} Jun 15 01:42:37.333548 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:37.333504 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-688f675699-grszb" podStartSLOduration=1.060196913 podStartE2EDuration="4.333488338s" totalImagesPullingTime="3.273291425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:37.331987913 +0000 UTC m=+233.182918749" watchObservedRunningTime="2026-06-15 01:42:37.333488338 +0000 UTC m=+233.184419177" Jun 15 01:42:38.303137 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:38.303100 2574 generic.go:356] "Generic (PLEG): container finished" podID="109dda05-f0cf-499a-9625-14ea38804475" containerID="1e5c28f1ba0b7691fda379567a8a63fa2f975b494f60ad8d17b3923ab5fae265" exitCode=0 Jun 15 01:42:38.303586 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:38.303153 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6qx6" event={"ID":"109dda05-f0cf-499a-9625-14ea38804475","Type":"ContainerDied","Data":"1e5c28f1ba0b7691fda379567a8a63fa2f975b494f60ad8d17b3923ab5fae265"} Jun 15 01:42:39.308440 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:39.308404 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6qx6" event={"ID":"109dda05-f0cf-499a-9625-14ea38804475","Type":"ContainerStarted","Data":"8a6a0687c468394c6d469dd238afdf0def78a17d6ffff38197df812c4ad0b2cb"} Jun 15 01:42:39.308807 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:39.308457 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m6qx6" event={"ID":"109dda05-f0cf-499a-9625-14ea38804475","Type":"ContainerStarted","Data":"63815fb7c790b10fe73fd4e0e6685306f8922d6df1518ef8f135347c8cd578b5"} Jun 15 01:42:39.325539 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:39.325491 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m6qx6" podStartSLOduration=3.424560702 podStartE2EDuration="5.325473194s" totalImagesPullingTime="1.826768953s" totalInitContainerRuntime="74.143539ms" isStatefulPod=true podCreationTimestamp="2026-06-15 01:42:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:39.324275594 +0000 UTC m=+235.175206455" watchObservedRunningTime="2026-06-15 01:42:39.325473194 +0000 UTC m=+235.176404028" Jun 15 01:42:41.097197 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.097151 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bcbdbfbdd-x5zqx"] Jun 15 01:42:41.100698 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.100672 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.107911 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.107670 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 01:42:41.110997 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.110970 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcbdbfbdd-x5zqx"] Jun 15 01:42:41.146136 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.146108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-oauth-serving-cert\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.146240 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.146143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-config\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.146240 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.146172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-serving-cert\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.146240 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.146196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46l5l\" (UniqueName: \"kubernetes.io/projected/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-kube-api-access-46l5l\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.146358 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.146285 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-trusted-ca-bundle\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.146358 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.146320 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-service-ca\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.146358 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.146339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-oauth-config\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.246948 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.246916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-service-ca\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.246948 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.246948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-oauth-config\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.247187 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.246979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-oauth-serving-cert\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.247187 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.247000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-config\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.247187 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.247020 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-serving-cert\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.247187 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.247055 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46l5l\" (UniqueName: \"kubernetes.io/projected/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-kube-api-access-46l5l\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.247187 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.247112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-trusted-ca-bundle\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.247764 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.247739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-service-ca\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.247904 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.247848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-oauth-serving-cert\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.247904 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.247848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-config\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.248039 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.248018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-trusted-ca-bundle\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.249492 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.249472 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-serving-cert\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.249603 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.249586 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-oauth-config\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.254051 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.254031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46l5l\" (UniqueName: \"kubernetes.io/projected/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-kube-api-access-46l5l\") pod \"console-bcbdbfbdd-x5zqx\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.411138 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.411069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:41.530352 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:41.530320 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bcbdbfbdd-x5zqx"] Jun 15 01:42:41.533672 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:41.533629 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f6f815_17a7_4b91_8a11_37a6db79e3b5.slice/crio-bf6370ecedab89b521fa55797608e3c761b513181cb0cf9c883ea1d6fa885eb8 WatchSource:0}: Error finding container bf6370ecedab89b521fa55797608e3c761b513181cb0cf9c883ea1d6fa885eb8: Status 404 returned error can't find the container with id bf6370ecedab89b521fa55797608e3c761b513181cb0cf9c883ea1d6fa885eb8 Jun 15 01:42:42.320158 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:42.320123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbdbfbdd-x5zqx" event={"ID":"e0f6f815-17a7-4b91-8a11-37a6db79e3b5","Type":"ContainerStarted","Data":"53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574"} Jun 15 01:42:42.320500 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:42.320199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbdbfbdd-x5zqx" event={"ID":"e0f6f815-17a7-4b91-8a11-37a6db79e3b5","Type":"ContainerStarted","Data":"bf6370ecedab89b521fa55797608e3c761b513181cb0cf9c883ea1d6fa885eb8"} Jun 15 01:42:42.335474 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:42.335429 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bcbdbfbdd-x5zqx" podStartSLOduration=1.33541469 podStartE2EDuration="1.33541469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:42.335018113 +0000 UTC m=+238.185948947" watchObservedRunningTime="2026-06-15 01:42:42.33541469 +0000 UTC m=+238.186345524" Jun 15 01:42:43.813109 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:43.813069 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:43.813507 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:43.813131 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-688f675699-grszb" Jun 15 01:42:43.814536 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:43.814511 2574 patch_prober.go:28] interesting pod/console-688f675699-grszb container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" start-of-body= Jun 15 01:42:43.814656 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:43.814554 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-688f675699-grszb" podUID="e16387e9-3119-4272-ad3e-613ec5f1083a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.13:8443/health\": dial tcp 10.134.0.13:8443: connect: connection refused" Jun 15 01:42:46.908859 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:46.908819 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688f675699-grszb"] Jun 15 01:42:46.935748 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:46.935724 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64694f84c7-bj5jz"] Jun 15 01:42:46.940084 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:46.940066 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:46.948777 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:46.948757 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64694f84c7-bj5jz"] Jun 15 01:42:47.016162 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.016137 2574 patch_prober.go:28] interesting pod/image-registry-779989c8df-wt6zj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:42:47.016277 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.016178 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:42:47.089512 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.089486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-serving-cert\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.089621 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.089523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-oauth-serving-cert\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.089621 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.089551 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-trusted-ca-bundle\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.089762 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.089682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-oauth-config\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.089762 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.089728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-config\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.089856 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.089774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-service-ca\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.089856 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.089798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf2h2\" (UniqueName: \"kubernetes.io/projected/c5f8b874-6250-4210-b229-6e0b28aa6f57-kube-api-access-sf2h2\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.190793 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.190742 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-trusted-ca-bundle\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.190869 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.190796 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-oauth-config\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.190869 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.190822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-config\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.190971 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.190862 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-service-ca\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.190971 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.190894 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf2h2\" (UniqueName: \"kubernetes.io/projected/c5f8b874-6250-4210-b229-6e0b28aa6f57-kube-api-access-sf2h2\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.190971 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.190929 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-serving-cert\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.191100 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.190970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-oauth-serving-cert\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.191683 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.191631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-service-ca\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.191832 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.191685 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-oauth-serving-cert\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.191832 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.191700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-trusted-ca-bundle\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.191832 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.191713 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-config\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.193218 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.193198 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-oauth-config\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.193363 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.193344 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-serving-cert\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.198418 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.198396 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf2h2\" (UniqueName: \"kubernetes.io/projected/c5f8b874-6250-4210-b229-6e0b28aa6f57-kube-api-access-sf2h2\") pod \"console-64694f84c7-bj5jz\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.248387 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.248370 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:47.393745 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:47.393717 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64694f84c7-bj5jz"] Jun 15 01:42:47.396988 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:47.396965 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f8b874_6250_4210_b229_6e0b28aa6f57.slice/crio-867c1b5a4f9345ce816bb78b5c4ba3b274206bd7a29a075d9200c06996f43cf4 WatchSource:0}: Error finding container 867c1b5a4f9345ce816bb78b5c4ba3b274206bd7a29a075d9200c06996f43cf4: Status 404 returned error can't find the container with id 867c1b5a4f9345ce816bb78b5c4ba3b274206bd7a29a075d9200c06996f43cf4 Jun 15 01:42:48.270856 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:48.270828 2574 patch_prober.go:28] interesting pod/image-registry-779989c8df-wt6zj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:42:48.271216 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:48.270876 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:42:48.341782 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:48.341755 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64694f84c7-bj5jz" event={"ID":"c5f8b874-6250-4210-b229-6e0b28aa6f57","Type":"ContainerStarted","Data":"e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882"} Jun 15 01:42:48.341930 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:48.341799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64694f84c7-bj5jz" event={"ID":"c5f8b874-6250-4210-b229-6e0b28aa6f57","Type":"ContainerStarted","Data":"867c1b5a4f9345ce816bb78b5c4ba3b274206bd7a29a075d9200c06996f43cf4"} Jun 15 01:42:48.358784 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:48.358743 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64694f84c7-bj5jz" podStartSLOduration=2.358728212 podStartE2EDuration="2.358728212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:42:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:48.357568269 +0000 UTC m=+244.208499114" watchObservedRunningTime="2026-06-15 01:42:48.358728212 +0000 UTC m=+244.209659434" Jun 15 01:42:51.411725 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:51.411675 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:51.412096 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:51.411763 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:42:51.412965 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:51.412944 2574 patch_prober.go:28] interesting pod/console-bcbdbfbdd-x5zqx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 15 01:42:51.413022 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:51.412984 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-bcbdbfbdd-x5zqx" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 15 01:42:56.455163 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:56.455128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:42:56.457587 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:56.457558 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01c71114-88ea-43c9-9b1e-5993cac19357-metrics-certs\") pod \"network-metrics-daemon-ddm5s\" (UID: \"01c71114-88ea-43c9-9b1e-5993cac19357\") " pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:42:56.607404 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:56.607379 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-46p56\"" Jun 15 01:42:56.615685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:56.615665 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddm5s" Jun 15 01:42:56.738950 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:56.738881 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ddm5s"] Jun 15 01:42:56.741927 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:42:56.741901 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c71114_88ea_43c9_9b1e_5993cac19357.slice/crio-f40bd5353166374d056dd8e07f96e175ea44647a001af71d507cfce70183db9f WatchSource:0}: Error finding container f40bd5353166374d056dd8e07f96e175ea44647a001af71d507cfce70183db9f: Status 404 returned error can't find the container with id f40bd5353166374d056dd8e07f96e175ea44647a001af71d507cfce70183db9f Jun 15 01:42:57.015920 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:57.015849 2574 patch_prober.go:28] interesting pod/image-registry-779989c8df-wt6zj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:42:57.015920 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:57.015893 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:42:57.248767 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:57.248734 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:57.249028 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:57.249009 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:42:57.250071 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:57.250038 2574 patch_prober.go:28] interesting pod/console-64694f84c7-bj5jz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 15 01:42:57.250181 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:57.250099 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64694f84c7-bj5jz" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 15 01:42:57.374402 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:57.374372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddm5s" event={"ID":"01c71114-88ea-43c9-9b1e-5993cac19357","Type":"ContainerStarted","Data":"f40bd5353166374d056dd8e07f96e175ea44647a001af71d507cfce70183db9f"} Jun 15 01:42:58.270863 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:58.270826 2574 patch_prober.go:28] interesting pod/image-registry-779989c8df-wt6zj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:42:58.271295 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:58.270894 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:42:58.379525 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:58.379491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddm5s" event={"ID":"01c71114-88ea-43c9-9b1e-5993cac19357","Type":"ContainerStarted","Data":"9fb56a0e9a01f7522cd281a8b853e8e6be2016aba1342d7a12babf3fdd610b06"} Jun 15 01:42:58.379675 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:58.379581 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddm5s" event={"ID":"01c71114-88ea-43c9-9b1e-5993cac19357","Type":"ContainerStarted","Data":"de48f71421d414eb84888c4c7bf4d48d7ed35f34d1f991e90895f19560f540b4"} Jun 15 01:42:58.393965 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:42:58.393882 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ddm5s" podStartSLOduration=253.468992974 podStartE2EDuration="4m14.393864188s" totalImagesPullingTime="924.871214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:42:58.392954596 +0000 UTC m=+254.243885431" watchObservedRunningTime="2026-06-15 01:42:58.393864188 +0000 UTC m=+254.244795022" Jun 15 01:43:01.412026 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:01.411953 2574 patch_prober.go:28] interesting pod/console-bcbdbfbdd-x5zqx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 15 01:43:01.412026 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:01.412009 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-bcbdbfbdd-x5zqx" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 15 01:43:07.015829 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:07.015796 2574 patch_prober.go:28] interesting pod/image-registry-779989c8df-wt6zj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:43:07.016258 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:07.015842 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:43:07.016258 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:07.015877 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:43:07.016362 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:07.016247 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"644bdef049a72f20d6b288030af270d42fc17e4ddfab278c277f803084e10568"} pod="openshift-image-registry/image-registry-779989c8df-wt6zj" containerMessage="Container registry failed liveness probe, will be restarted" Jun 15 01:43:07.019726 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:07.019702 2574 patch_prober.go:28] interesting pod/image-registry-779989c8df-wt6zj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:43:07.019838 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:07.019739 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:43:07.249272 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:07.249241 2574 patch_prober.go:28] interesting pod/console-64694f84c7-bj5jz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 15 01:43:07.249406 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:07.249292 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64694f84c7-bj5jz" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 15 01:43:11.411745 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:11.411706 2574 patch_prober.go:28] interesting pod/console-bcbdbfbdd-x5zqx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 15 01:43:11.412149 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:11.411767 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-bcbdbfbdd-x5zqx" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 15 01:43:11.927759 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:11.927709 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-688f675699-grszb" podUID="e16387e9-3119-4272-ad3e-613ec5f1083a" containerName="console" containerID="cri-o://f66725f6ab806d9e291a4220bc4341589af4761e6c694175307c2181ac22d248" gracePeriod=15 Jun 15 01:43:17.020543 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:17.020511 2574 patch_prober.go:28] interesting pod/image-registry-779989c8df-wt6zj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:43:17.020911 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:17.020558 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:43:17.249095 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:17.249066 2574 patch_prober.go:28] interesting pod/console-64694f84c7-bj5jz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 15 01:43:17.249227 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:17.249108 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64694f84c7-bj5jz" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 15 01:43:21.083349 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:21.083320 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6qx6_109dda05-f0cf-499a-9625-14ea38804475/init-textfile/0.log" Jun 15 01:43:21.172189 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:21.172158 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" podUID="62e0037b-1f5b-4f1c-9a2a-e91b55a47fec" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 01:43:21.282716 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:21.282691 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6qx6_109dda05-f0cf-499a-9625-14ea38804475/node-exporter/0.log" Jun 15 01:43:21.411689 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:21.411599 2574 patch_prober.go:28] interesting pod/console-bcbdbfbdd-x5zqx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 15 01:43:21.411689 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:21.411664 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-bcbdbfbdd-x5zqx" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 15 01:43:21.482125 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:21.482098 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6qx6_109dda05-f0cf-499a-9625-14ea38804475/kube-rbac-proxy/0.log" Jun 15 01:43:25.070054 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:43:25.070022 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-krlqp" podUID="4ba0ff22-7715-4be4-98f0-dd8e2af4625a" Jun 15 01:43:25.467607 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:25.467582 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-krlqp" Jun 15 01:43:26.682415 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:26.682388 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-64694f84c7-bj5jz_c5f8b874-6250-4210-b229-6e0b28aa6f57/console/0.log" Jun 15 01:43:26.882299 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:26.882271 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-688f675699-grszb_e16387e9-3119-4272-ad3e-613ec5f1083a/console/0.log" Jun 15 01:43:27.020748 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.020719 2574 patch_prober.go:28] interesting pod/image-registry-779989c8df-wt6zj container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 01:43:27.020864 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.020772 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 01:43:27.084013 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.083989 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-bcbdbfbdd-x5zqx_e0f6f815-17a7-4b91-8a11-37a6db79e3b5/console/0.log" Jun 15 01:43:27.249214 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.249154 2574 patch_prober.go:28] interesting pod/console-64694f84c7-bj5jz container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 15 01:43:27.249214 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.249204 2574 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-64694f84c7-bj5jz" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 15 01:43:27.475935 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.475916 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-688f675699-grszb_e16387e9-3119-4272-ad3e-613ec5f1083a/console/0.log" Jun 15 01:43:27.476055 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.475949 2574 generic.go:356] "Generic (PLEG): container finished" podID="e16387e9-3119-4272-ad3e-613ec5f1083a" containerID="f66725f6ab806d9e291a4220bc4341589af4761e6c694175307c2181ac22d248" exitCode=137 Jun 15 01:43:27.476055 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.476022 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688f675699-grszb" event={"ID":"e16387e9-3119-4272-ad3e-613ec5f1083a","Type":"ContainerDied","Data":"f66725f6ab806d9e291a4220bc4341589af4761e6c694175307c2181ac22d248"} Jun 15 01:43:27.561283 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.561265 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-688f675699-grszb_e16387e9-3119-4272-ad3e-613ec5f1083a/console/0.log" Jun 15 01:43:27.562616 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.562601 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688f675699-grszb" Jun 15 01:43:27.669195 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669165 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-console-config\") pod \"e16387e9-3119-4272-ad3e-613ec5f1083a\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " Jun 15 01:43:27.669320 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669203 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-oauth-serving-cert\") pod \"e16387e9-3119-4272-ad3e-613ec5f1083a\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " Jun 15 01:43:27.669320 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669233 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9gts\" (UniqueName: \"kubernetes.io/projected/e16387e9-3119-4272-ad3e-613ec5f1083a-kube-api-access-c9gts\") pod \"e16387e9-3119-4272-ad3e-613ec5f1083a\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " Jun 15 01:43:27.669320 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669260 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-serving-cert\") pod \"e16387e9-3119-4272-ad3e-613ec5f1083a\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " Jun 15 01:43:27.669320 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669287 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-oauth-config\") pod \"e16387e9-3119-4272-ad3e-613ec5f1083a\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " Jun 15 01:43:27.669320 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669309 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-service-ca\") pod \"e16387e9-3119-4272-ad3e-613ec5f1083a\" (UID: \"e16387e9-3119-4272-ad3e-613ec5f1083a\") " Jun 15 01:43:27.669601 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669569 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-console-config" (OuterVolumeSpecName: "console-config") pod "e16387e9-3119-4272-ad3e-613ec5f1083a" (UID: "e16387e9-3119-4272-ad3e-613ec5f1083a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:27.669601 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669581 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e16387e9-3119-4272-ad3e-613ec5f1083a" (UID: "e16387e9-3119-4272-ad3e-613ec5f1083a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:27.669765 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669745 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-console-config\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:43:27.669889 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.669799 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-service-ca" (OuterVolumeSpecName: "service-ca") pod "e16387e9-3119-4272-ad3e-613ec5f1083a" (UID: "e16387e9-3119-4272-ad3e-613ec5f1083a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:43:27.671465 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.671442 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e16387e9-3119-4272-ad3e-613ec5f1083a" (UID: "e16387e9-3119-4272-ad3e-613ec5f1083a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:27.671549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.671522 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e16387e9-3119-4272-ad3e-613ec5f1083a-kube-api-access-c9gts" (OuterVolumeSpecName: "kube-api-access-c9gts") pod "e16387e9-3119-4272-ad3e-613ec5f1083a" (UID: "e16387e9-3119-4272-ad3e-613ec5f1083a"). InnerVolumeSpecName "kube-api-access-c9gts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:43:27.671549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.671532 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e16387e9-3119-4272-ad3e-613ec5f1083a" (UID: "e16387e9-3119-4272-ad3e-613ec5f1083a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:43:27.770073 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.770041 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-serving-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:43:27.770073 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.770068 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e16387e9-3119-4272-ad3e-613ec5f1083a-console-oauth-config\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:43:27.770406 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.770081 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-service-ca\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:43:27.770406 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.770094 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e16387e9-3119-4272-ad3e-613ec5f1083a-oauth-serving-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:43:27.770406 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:27.770107 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9gts\" (UniqueName: \"kubernetes.io/projected/e16387e9-3119-4272-ad3e-613ec5f1083a-kube-api-access-c9gts\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:43:28.480873 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.480848 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-688f675699-grszb_e16387e9-3119-4272-ad3e-613ec5f1083a/console/0.log" Jun 15 01:43:28.481027 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.480893 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-688f675699-grszb" event={"ID":"e16387e9-3119-4272-ad3e-613ec5f1083a","Type":"ContainerDied","Data":"36476f655558210fa1e842d9c6b336f148abed2c1c2c611d6fe1cb21bb6d502c"} Jun 15 01:43:28.481027 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.480930 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-688f675699-grszb" Jun 15 01:43:28.481027 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.480948 2574 scope.go:117] "RemoveContainer" containerID="f66725f6ab806d9e291a4220bc4341589af4761e6c694175307c2181ac22d248" Jun 15 01:43:28.500000 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.499979 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-688f675699-grszb"] Jun 15 01:43:28.503010 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.502991 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-688f675699-grszb"] Jun 15 01:43:28.508228 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.508210 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e16387e9-3119-4272-ad3e-613ec5f1083a" path="/var/lib/kubelet/pods/e16387e9-3119-4272-ad3e-613ec5f1083a/volumes" Jun 15 01:43:28.877749 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.877719 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:43:28.879990 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:28.879965 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ba0ff22-7715-4be4-98f0-dd8e2af4625a-metrics-tls\") pod \"dns-default-krlqp\" (UID: \"4ba0ff22-7715-4be4-98f0-dd8e2af4625a\") " pod="openshift-dns/dns-default-krlqp" Jun 15 01:43:29.070391 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.070369 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55pqm\"" Jun 15 01:43:29.078894 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.078873 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-krlqp" Jun 15 01:43:29.082749 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.082734 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t8rgh_7f2a2af3-7443-492d-a735-04f9c1e8961b/dns-node-resolver/0.log" Jun 15 01:43:29.201582 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.201554 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-krlqp"] Jun 15 01:43:29.204518 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:43:29.204492 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ba0ff22_7715_4be4_98f0_dd8e2af4625a.slice/crio-d44ba2efd76cff9b16c836a5b2a30680d9029d13c32426fab83f2557e117dc8a WatchSource:0}: Error finding container d44ba2efd76cff9b16c836a5b2a30680d9029d13c32426fab83f2557e117dc8a: Status 404 returned error can't find the container with id d44ba2efd76cff9b16c836a5b2a30680d9029d13c32426fab83f2557e117dc8a Jun 15 01:43:29.282454 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.282434 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-779989c8df-wt6zj_05945e40-eea9-4bba-838c-3f19150f0f77/registry/0.log" Jun 15 01:43:29.486464 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.486408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-krlqp" event={"ID":"4ba0ff22-7715-4be4-98f0-dd8e2af4625a","Type":"ContainerStarted","Data":"d44ba2efd76cff9b16c836a5b2a30680d9029d13c32426fab83f2557e117dc8a"} Jun 15 01:43:29.487743 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.487719 2574 generic.go:356] "Generic (PLEG): container finished" podID="876c6f2c-ddfc-4ba0-9685-a07d11eb52ef" containerID="ae4377c3b738c95348dddfe9aec97125ebe33e711fa82736fe431b22aec51ec3" exitCode=0 Jun 15 01:43:29.487832 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.487765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" event={"ID":"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef","Type":"ContainerDied","Data":"ae4377c3b738c95348dddfe9aec97125ebe33e711fa82736fe431b22aec51ec3"} Jun 15 01:43:29.488010 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.487997 2574 scope.go:117] "RemoveContainer" containerID="ae4377c3b738c95348dddfe9aec97125ebe33e711fa82736fe431b22aec51ec3" Jun 15 01:43:29.682517 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:29.682465 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5pfh_758f4a15-f524-48f4-a92e-555379652796/node-ca/0.log" Jun 15 01:43:30.493791 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:30.493756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-j97cq" event={"ID":"876c6f2c-ddfc-4ba0-9685-a07d11eb52ef","Type":"ContainerStarted","Data":"3dad7e85f93f6002fe9350e7d84a806891e435b3f79f297747ada3dfe544f57d"} Jun 15 01:43:30.882189 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:30.882160 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p66kz_8cbacee2-636d-4e29-a8fe-f6470080f24c/serve-healthcheck-canary/0.log" Jun 15 01:43:31.172498 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:31.172462 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" podUID="62e0037b-1f5b-4f1c-9a2a-e91b55a47fec" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 01:43:31.415499 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:31.415463 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:43:31.419447 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:31.419425 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:43:31.500063 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:31.499967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-krlqp" event={"ID":"4ba0ff22-7715-4be4-98f0-dd8e2af4625a","Type":"ContainerStarted","Data":"5cf4c50c2b0f22803855c8be357b73642f4a0e55623735543573b4bbfda28251"} Jun 15 01:43:31.500063 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:31.500023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-krlqp" event={"ID":"4ba0ff22-7715-4be4-98f0-dd8e2af4625a","Type":"ContainerStarted","Data":"18741f1952db02ad95d400d9ad3299bf6c84e7722cda9496bc4d5cb3431a8e42"} Jun 15 01:43:31.523649 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:31.523577 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-krlqp" podStartSLOduration=252.06247101 podStartE2EDuration="4m13.523555676s" totalImagesPullingTime="1.461084666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:43:31.521571841 +0000 UTC m=+287.372502722" watchObservedRunningTime="2026-06-15 01:43:31.523555676 +0000 UTC m=+287.374486510" Jun 15 01:43:32.036269 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:32.036112 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" podUID="05945e40-eea9-4bba-838c-3f19150f0f77" containerName="registry" containerID="cri-o://644bdef049a72f20d6b288030af270d42fc17e4ddfab278c277f803084e10568" gracePeriod=30 Jun 15 01:43:32.509095 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:32.509064 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-krlqp" Jun 15 01:43:33.512974 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:33.512900 2574 generic.go:356] "Generic (PLEG): container finished" podID="05945e40-eea9-4bba-838c-3f19150f0f77" containerID="644bdef049a72f20d6b288030af270d42fc17e4ddfab278c277f803084e10568" exitCode=0 Jun 15 01:43:33.513312 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:33.512977 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" event={"ID":"05945e40-eea9-4bba-838c-3f19150f0f77","Type":"ContainerDied","Data":"644bdef049a72f20d6b288030af270d42fc17e4ddfab278c277f803084e10568"} Jun 15 01:43:33.513312 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:33.513028 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" event={"ID":"05945e40-eea9-4bba-838c-3f19150f0f77","Type":"ContainerStarted","Data":"10a3716d22f546fc189619e50aeb57b877fa9146be775aae720ffd0af63a6cb1"} Jun 15 01:43:33.513394 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:33.513332 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:43:37.253804 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:37.253730 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:43:37.257767 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:37.257746 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:43:37.311217 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:37.311194 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcbdbfbdd-x5zqx"] Jun 15 01:43:41.172018 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:41.171981 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" podUID="62e0037b-1f5b-4f1c-9a2a-e91b55a47fec" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 15 01:43:41.172368 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:41.172067 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" Jun 15 01:43:41.172533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:41.172517 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"29725f996ee9ebc124eaae6d9f78a279fdb1d54f89a151eb7f1c45e564ec3f01"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 15 01:43:41.172571 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:41.172552 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" podUID="62e0037b-1f5b-4f1c-9a2a-e91b55a47fec" containerName="service-proxy" containerID="cri-o://29725f996ee9ebc124eaae6d9f78a279fdb1d54f89a151eb7f1c45e564ec3f01" gracePeriod=30 Jun 15 01:43:41.543569 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:41.543489 2574 generic.go:356] "Generic (PLEG): container finished" podID="62e0037b-1f5b-4f1c-9a2a-e91b55a47fec" containerID="29725f996ee9ebc124eaae6d9f78a279fdb1d54f89a151eb7f1c45e564ec3f01" exitCode=2 Jun 15 01:43:41.543569 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:41.543552 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" event={"ID":"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec","Type":"ContainerDied","Data":"29725f996ee9ebc124eaae6d9f78a279fdb1d54f89a151eb7f1c45e564ec3f01"} Jun 15 01:43:41.543765 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:41.543586 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7885dbbffc-m7cvj" event={"ID":"62e0037b-1f5b-4f1c-9a2a-e91b55a47fec","Type":"ContainerStarted","Data":"87f739e8f53274b0c8ddfa4bf86029980fad0e86473591d4a40cdbedb0b0ff6d"} Jun 15 01:43:42.515044 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:42.515017 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-krlqp" Jun 15 01:43:44.467015 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:44.466982 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:43:44.468145 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:44.468122 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:43:44.474748 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:44.474730 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 01:43:51.309847 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.309814 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c48f898dd-mm4zh"] Jun 15 01:43:51.312204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.310050 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e16387e9-3119-4272-ad3e-613ec5f1083a" containerName="console" Jun 15 01:43:51.312204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.310064 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e16387e9-3119-4272-ad3e-613ec5f1083a" containerName="console" Jun 15 01:43:51.312204 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.310132 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e16387e9-3119-4272-ad3e-613ec5f1083a" containerName="console" Jun 15 01:43:51.313072 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.313055 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.324569 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.324547 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c48f898dd-mm4zh"] Jun 15 01:43:51.432113 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.432086 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-console-config\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.432237 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.432133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-oauth-config\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.432237 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.432157 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-trusted-ca-bundle\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.432237 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.432196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-oauth-serving-cert\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.432338 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.432288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-service-ca\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.432338 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.432332 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-serving-cert\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.432404 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.432368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qswv7\" (UniqueName: \"kubernetes.io/projected/a613a341-9412-4923-8afa-fcb740e278f8-kube-api-access-qswv7\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.532866 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.532841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-oauth-config\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.532866 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.532866 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-trusted-ca-bundle\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.533042 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.532880 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-oauth-serving-cert\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.533042 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.532920 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-service-ca\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.533042 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.532951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-serving-cert\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.533042 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.532991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qswv7\" (UniqueName: \"kubernetes.io/projected/a613a341-9412-4923-8afa-fcb740e278f8-kube-api-access-qswv7\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.533042 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.533025 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-console-config\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.533709 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.533686 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-service-ca\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.533845 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.533733 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-oauth-serving-cert\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.533845 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.533734 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-console-config\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.534069 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.534047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-trusted-ca-bundle\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.535414 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.535391 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-oauth-config\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.535554 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.535538 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-serving-cert\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.540203 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.540184 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qswv7\" (UniqueName: \"kubernetes.io/projected/a613a341-9412-4923-8afa-fcb740e278f8-kube-api-access-qswv7\") pod \"console-5c48f898dd-mm4zh\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.621266 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.621241 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:43:51.750501 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:51.750470 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c48f898dd-mm4zh"] Jun 15 01:43:51.753417 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:43:51.753388 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda613a341_9412_4923_8afa_fcb740e278f8.slice/crio-20160f9274d92698e44418a58145edabe4f9c02747347fbcdf47b1b2e66612b6 WatchSource:0}: Error finding container 20160f9274d92698e44418a58145edabe4f9c02747347fbcdf47b1b2e66612b6: Status 404 returned error can't find the container with id 20160f9274d92698e44418a58145edabe4f9c02747347fbcdf47b1b2e66612b6 Jun 15 01:43:52.581940 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:52.581910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c48f898dd-mm4zh" event={"ID":"a613a341-9412-4923-8afa-fcb740e278f8","Type":"ContainerStarted","Data":"77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789"} Jun 15 01:43:52.582351 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:52.581951 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c48f898dd-mm4zh" event={"ID":"a613a341-9412-4923-8afa-fcb740e278f8","Type":"ContainerStarted","Data":"20160f9274d92698e44418a58145edabe4f9c02747347fbcdf47b1b2e66612b6"} Jun 15 01:43:52.598488 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:52.598443 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c48f898dd-mm4zh" podStartSLOduration=1.598430852 podStartE2EDuration="1.598430852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:43:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:43:52.597121212 +0000 UTC m=+308.448052057" watchObservedRunningTime="2026-06-15 01:43:52.598430852 +0000 UTC m=+308.449361747" Jun 15 01:43:54.521150 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:43:54.521127 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-779989c8df-wt6zj" Jun 15 01:44:01.621477 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:01.621445 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:44:01.621905 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:01.621501 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:44:01.626105 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:01.626086 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:44:02.330501 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.330438 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-bcbdbfbdd-x5zqx" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerName="console" containerID="cri-o://53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574" gracePeriod=15 Jun 15 01:44:02.571210 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.571186 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:44:02.607000 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.606930 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-trusted-ca-bundle\") pod \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " Jun 15 01:44:02.607000 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.606980 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-oauth-config\") pod \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " Jun 15 01:44:02.607190 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607011 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-service-ca\") pod \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " Jun 15 01:44:02.607190 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607048 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46l5l\" (UniqueName: \"kubernetes.io/projected/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-kube-api-access-46l5l\") pod \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " Jun 15 01:44:02.607190 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607077 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-config\") pod \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " Jun 15 01:44:02.607190 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607167 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-oauth-serving-cert\") pod \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " Jun 15 01:44:02.607388 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607195 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-serving-cert\") pod \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\" (UID: \"e0f6f815-17a7-4b91-8a11-37a6db79e3b5\") " Jun 15 01:44:02.607388 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607351 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e0f6f815-17a7-4b91-8a11-37a6db79e3b5" (UID: "e0f6f815-17a7-4b91-8a11-37a6db79e3b5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:02.607490 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607407 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0f6f815-17a7-4b91-8a11-37a6db79e3b5" (UID: "e0f6f815-17a7-4b91-8a11-37a6db79e3b5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:02.607490 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607444 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-config" (OuterVolumeSpecName: "console-config") pod "e0f6f815-17a7-4b91-8a11-37a6db79e3b5" (UID: "e0f6f815-17a7-4b91-8a11-37a6db79e3b5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:02.607671 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.607627 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0f6f815-17a7-4b91-8a11-37a6db79e3b5" (UID: "e0f6f815-17a7-4b91-8a11-37a6db79e3b5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:02.609359 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.609333 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0f6f815-17a7-4b91-8a11-37a6db79e3b5" (UID: "e0f6f815-17a7-4b91-8a11-37a6db79e3b5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:44:02.609630 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.609607 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0f6f815-17a7-4b91-8a11-37a6db79e3b5" (UID: "e0f6f815-17a7-4b91-8a11-37a6db79e3b5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:44:02.609718 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.609617 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-kube-api-access-46l5l" (OuterVolumeSpecName: "kube-api-access-46l5l") pod "e0f6f815-17a7-4b91-8a11-37a6db79e3b5" (UID: "e0f6f815-17a7-4b91-8a11-37a6db79e3b5"). InnerVolumeSpecName "kube-api-access-46l5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:44:02.617498 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.617476 2574 generic.go:356] "Generic (PLEG): container finished" podID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerID="53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574" exitCode=0 Jun 15 01:44:02.617595 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.617528 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bcbdbfbdd-x5zqx" Jun 15 01:44:02.617595 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.617568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbdbfbdd-x5zqx" event={"ID":"e0f6f815-17a7-4b91-8a11-37a6db79e3b5","Type":"ContainerDied","Data":"53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574"} Jun 15 01:44:02.617728 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.617619 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bcbdbfbdd-x5zqx" event={"ID":"e0f6f815-17a7-4b91-8a11-37a6db79e3b5","Type":"ContainerDied","Data":"bf6370ecedab89b521fa55797608e3c761b513181cb0cf9c883ea1d6fa885eb8"} Jun 15 01:44:02.617728 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.617663 2574 scope.go:117] "RemoveContainer" containerID="53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574" Jun 15 01:44:02.622119 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.622093 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:44:02.626477 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.626463 2574 scope.go:117] "RemoveContainer" containerID="53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574" Jun 15 01:44:02.626762 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:44:02.626743 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574\": container with ID starting with 53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574 not found: ID does not exist" containerID="53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574" Jun 15 01:44:02.626822 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.626769 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574"} err="failed to get container status \"53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574\": rpc error: code = NotFound desc = could not find container \"53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574\": container with ID starting with 53915781e86e41ffa18c0aa0277572a52df051834164850686dea287f7de0574 not found: ID does not exist" Jun 15 01:44:02.655121 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.655102 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bcbdbfbdd-x5zqx"] Jun 15 01:44:02.658574 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.658555 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bcbdbfbdd-x5zqx"] Jun 15 01:44:02.673433 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.673411 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64694f84c7-bj5jz"] Jun 15 01:44:02.708324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.708209 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-oauth-serving-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:02.708324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.708236 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-serving-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:02.708324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.708250 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-trusted-ca-bundle\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:02.708324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.708263 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-oauth-config\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:02.708324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.708277 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-service-ca\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:02.708324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.708290 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46l5l\" (UniqueName: \"kubernetes.io/projected/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-kube-api-access-46l5l\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:02.708324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:02.708303 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0f6f815-17a7-4b91-8a11-37a6db79e3b5-console-config\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:04.509276 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:04.509246 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" path="/var/lib/kubelet/pods/e0f6f815-17a7-4b91-8a11-37a6db79e3b5/volumes" Jun 15 01:44:27.692786 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.692741 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-64694f84c7-bj5jz" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerName="console" containerID="cri-o://e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882" gracePeriod=15 Jun 15 01:44:27.924376 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.924354 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:44:27.977256 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977190 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-oauth-config\") pod \"c5f8b874-6250-4210-b229-6e0b28aa6f57\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " Jun 15 01:44:27.977256 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977239 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-trusted-ca-bundle\") pod \"c5f8b874-6250-4210-b229-6e0b28aa6f57\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " Jun 15 01:44:27.977441 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977265 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-oauth-serving-cert\") pod \"c5f8b874-6250-4210-b229-6e0b28aa6f57\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " Jun 15 01:44:27.977441 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977365 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-config\") pod \"c5f8b874-6250-4210-b229-6e0b28aa6f57\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " Jun 15 01:44:27.977441 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977416 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-service-ca\") pod \"c5f8b874-6250-4210-b229-6e0b28aa6f57\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " Jun 15 01:44:27.977593 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977455 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-serving-cert\") pod \"c5f8b874-6250-4210-b229-6e0b28aa6f57\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " Jun 15 01:44:27.977593 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977478 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf2h2\" (UniqueName: \"kubernetes.io/projected/c5f8b874-6250-4210-b229-6e0b28aa6f57-kube-api-access-sf2h2\") pod \"c5f8b874-6250-4210-b229-6e0b28aa6f57\" (UID: \"c5f8b874-6250-4210-b229-6e0b28aa6f57\") " Jun 15 01:44:27.977727 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977706 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c5f8b874-6250-4210-b229-6e0b28aa6f57" (UID: "c5f8b874-6250-4210-b229-6e0b28aa6f57"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:27.977778 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977730 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c5f8b874-6250-4210-b229-6e0b28aa6f57" (UID: "c5f8b874-6250-4210-b229-6e0b28aa6f57"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:27.977826 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977806 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-config" (OuterVolumeSpecName: "console-config") pod "c5f8b874-6250-4210-b229-6e0b28aa6f57" (UID: "c5f8b874-6250-4210-b229-6e0b28aa6f57"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:27.977866 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.977817 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-service-ca" (OuterVolumeSpecName: "service-ca") pod "c5f8b874-6250-4210-b229-6e0b28aa6f57" (UID: "c5f8b874-6250-4210-b229-6e0b28aa6f57"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:44:27.979225 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.979194 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c5f8b874-6250-4210-b229-6e0b28aa6f57" (UID: "c5f8b874-6250-4210-b229-6e0b28aa6f57"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:44:27.979495 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.979478 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5f8b874-6250-4210-b229-6e0b28aa6f57-kube-api-access-sf2h2" (OuterVolumeSpecName: "kube-api-access-sf2h2") pod "c5f8b874-6250-4210-b229-6e0b28aa6f57" (UID: "c5f8b874-6250-4210-b229-6e0b28aa6f57"). InnerVolumeSpecName "kube-api-access-sf2h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:44:27.979579 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:27.979556 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c5f8b874-6250-4210-b229-6e0b28aa6f57" (UID: "c5f8b874-6250-4210-b229-6e0b28aa6f57"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:44:28.078685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.078661 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-serving-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:28.078685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.078681 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf2h2\" (UniqueName: \"kubernetes.io/projected/c5f8b874-6250-4210-b229-6e0b28aa6f57-kube-api-access-sf2h2\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:28.078806 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.078690 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-oauth-config\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:28.078806 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.078699 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-trusted-ca-bundle\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:28.078806 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.078708 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-oauth-serving-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:28.078806 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.078717 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-console-config\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:28.078806 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.078725 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c5f8b874-6250-4210-b229-6e0b28aa6f57-service-ca\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:44:28.705116 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.705085 2574 generic.go:356] "Generic (PLEG): container finished" podID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerID="e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882" exitCode=0 Jun 15 01:44:28.705535 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.705127 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64694f84c7-bj5jz" Jun 15 01:44:28.705535 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.705156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64694f84c7-bj5jz" event={"ID":"c5f8b874-6250-4210-b229-6e0b28aa6f57","Type":"ContainerDied","Data":"e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882"} Jun 15 01:44:28.705535 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.705193 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64694f84c7-bj5jz" event={"ID":"c5f8b874-6250-4210-b229-6e0b28aa6f57","Type":"ContainerDied","Data":"867c1b5a4f9345ce816bb78b5c4ba3b274206bd7a29a075d9200c06996f43cf4"} Jun 15 01:44:28.705535 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.705212 2574 scope.go:117] "RemoveContainer" containerID="e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882" Jun 15 01:44:28.712619 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.712604 2574 scope.go:117] "RemoveContainer" containerID="e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882" Jun 15 01:44:28.712879 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:44:28.712859 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882\": container with ID starting with e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882 not found: ID does not exist" containerID="e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882" Jun 15 01:44:28.712940 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.712887 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882"} err="failed to get container status \"e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882\": rpc error: code = NotFound desc = could not find container \"e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882\": container with ID starting with e69c5a832bbbbe997b6ac03e4d6091c003302b59b299d654d28668b67e465882 not found: ID does not exist" Jun 15 01:44:28.718770 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.718749 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64694f84c7-bj5jz"] Jun 15 01:44:28.722181 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:28.722154 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64694f84c7-bj5jz"] Jun 15 01:44:30.508653 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:44:30.508572 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" path="/var/lib/kubelet/pods/c5f8b874-6250-4210-b229-6e0b28aa6f57/volumes" Jun 15 01:47:45.993131 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.993092 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2"] Jun 15 01:47:45.993581 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.993337 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerName="console" Jun 15 01:47:45.993581 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.993350 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerName="console" Jun 15 01:47:45.993581 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.993362 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerName="console" Jun 15 01:47:45.993581 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.993367 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerName="console" Jun 15 01:47:45.993581 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.993418 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f6f815-17a7-4b91-8a11-37a6db79e3b5" containerName="console" Jun 15 01:47:45.993581 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.993426 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5f8b874-6250-4210-b229-6e0b28aa6f57" containerName="console" Jun 15 01:47:45.996103 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.996087 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" Jun 15 01:47:45.998125 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.998106 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-fbfgf\"" Jun 15 01:47:45.998125 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.998117 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:47:45.998277 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:45.998149 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 15 01:47:46.008263 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.008242 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2"] Jun 15 01:47:46.080653 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.080608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hbhn\" (UniqueName: \"kubernetes.io/projected/4ad4029f-2f66-4241-90bc-5320966ba097-kube-api-access-4hbhn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-n7zn2\" (UID: \"4ad4029f-2f66-4241-90bc-5320966ba097\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" Jun 15 01:47:46.080781 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.080674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ad4029f-2f66-4241-90bc-5320966ba097-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-n7zn2\" (UID: \"4ad4029f-2f66-4241-90bc-5320966ba097\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" Jun 15 01:47:46.181408 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.181376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hbhn\" (UniqueName: \"kubernetes.io/projected/4ad4029f-2f66-4241-90bc-5320966ba097-kube-api-access-4hbhn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-n7zn2\" (UID: \"4ad4029f-2f66-4241-90bc-5320966ba097\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" Jun 15 01:47:46.181566 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.181423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ad4029f-2f66-4241-90bc-5320966ba097-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-n7zn2\" (UID: \"4ad4029f-2f66-4241-90bc-5320966ba097\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" Jun 15 01:47:46.181813 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.181794 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ad4029f-2f66-4241-90bc-5320966ba097-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-n7zn2\" (UID: \"4ad4029f-2f66-4241-90bc-5320966ba097\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" Jun 15 01:47:46.194507 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.194485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hbhn\" (UniqueName: \"kubernetes.io/projected/4ad4029f-2f66-4241-90bc-5320966ba097-kube-api-access-4hbhn\") pod \"cert-manager-operator-controller-manager-57757f7cfc-n7zn2\" (UID: \"4ad4029f-2f66-4241-90bc-5320966ba097\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" Jun 15 01:47:46.304057 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.303999 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" Jun 15 01:47:46.434040 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.434007 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2"] Jun 15 01:47:46.437120 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:47:46.437090 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad4029f_2f66_4241_90bc_5320966ba097.slice/crio-04e9d1c8981440e4685ee4fd7f7bbb153f449451fbc28199627c17b87a70069e WatchSource:0}: Error finding container 04e9d1c8981440e4685ee4fd7f7bbb153f449451fbc28199627c17b87a70069e: Status 404 returned error can't find the container with id 04e9d1c8981440e4685ee4fd7f7bbb153f449451fbc28199627c17b87a70069e Jun 15 01:47:46.439675 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:46.439660 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:47:47.371820 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:47.371787 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" event={"ID":"4ad4029f-2f66-4241-90bc-5320966ba097","Type":"ContainerStarted","Data":"04e9d1c8981440e4685ee4fd7f7bbb153f449451fbc28199627c17b87a70069e"} Jun 15 01:47:50.383554 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:50.383512 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" event={"ID":"4ad4029f-2f66-4241-90bc-5320966ba097","Type":"ContainerStarted","Data":"ea2712930c497ad203592e21211727d804f1c4ef6182770b4bfd0fe5034914bd"} Jun 15 01:47:50.404491 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:50.404450 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-n7zn2" podStartSLOduration=2.428173057 podStartE2EDuration="5.404435983s" totalImagesPullingTime="2.976262926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:47:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:47:50.40385205 +0000 UTC m=+546.254782884" watchObservedRunningTime="2026-06-15 01:47:50.404435983 +0000 UTC m=+546.255366817" Jun 15 01:47:55.724366 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.724331 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-spqwx"] Jun 15 01:47:55.727460 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.727443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" Jun 15 01:47:55.729440 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.729419 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 15 01:47:55.729587 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.729567 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-79bxn\"" Jun 15 01:47:55.729904 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.729888 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 15 01:47:55.734991 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.734971 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-spqwx"] Jun 15 01:47:55.851766 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.851739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3515d5a-549a-4847-8f68-b7bbbd50f253-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-spqwx\" (UID: \"a3515d5a-549a-4847-8f68-b7bbbd50f253\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" Jun 15 01:47:55.851766 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.851772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl8hf\" (UniqueName: \"kubernetes.io/projected/a3515d5a-549a-4847-8f68-b7bbbd50f253-kube-api-access-vl8hf\") pod \"cert-manager-cainjector-5d99449ffd-spqwx\" (UID: \"a3515d5a-549a-4847-8f68-b7bbbd50f253\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" Jun 15 01:47:55.952319 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.952292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3515d5a-549a-4847-8f68-b7bbbd50f253-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-spqwx\" (UID: \"a3515d5a-549a-4847-8f68-b7bbbd50f253\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" Jun 15 01:47:55.952510 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.952335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl8hf\" (UniqueName: \"kubernetes.io/projected/a3515d5a-549a-4847-8f68-b7bbbd50f253-kube-api-access-vl8hf\") pod \"cert-manager-cainjector-5d99449ffd-spqwx\" (UID: \"a3515d5a-549a-4847-8f68-b7bbbd50f253\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" Jun 15 01:47:55.960404 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.960372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a3515d5a-549a-4847-8f68-b7bbbd50f253-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-spqwx\" (UID: \"a3515d5a-549a-4847-8f68-b7bbbd50f253\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" Jun 15 01:47:55.960527 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:55.960460 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl8hf\" (UniqueName: \"kubernetes.io/projected/a3515d5a-549a-4847-8f68-b7bbbd50f253-kube-api-access-vl8hf\") pod \"cert-manager-cainjector-5d99449ffd-spqwx\" (UID: \"a3515d5a-549a-4847-8f68-b7bbbd50f253\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" Jun 15 01:47:56.036435 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:56.036347 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" Jun 15 01:47:56.158960 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:56.158925 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-spqwx"] Jun 15 01:47:56.164971 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:47:56.164944 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda3515d5a_549a_4847_8f68_b7bbbd50f253.slice/crio-3b678ac71d6662255279a93409069127fad912f4e4c7bb6f66509b70da03df0a WatchSource:0}: Error finding container 3b678ac71d6662255279a93409069127fad912f4e4c7bb6f66509b70da03df0a: Status 404 returned error can't find the container with id 3b678ac71d6662255279a93409069127fad912f4e4c7bb6f66509b70da03df0a Jun 15 01:47:56.404160 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:56.404129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" event={"ID":"a3515d5a-549a-4847-8f68-b7bbbd50f253","Type":"ContainerStarted","Data":"3b678ac71d6662255279a93409069127fad912f4e4c7bb6f66509b70da03df0a"} Jun 15 01:47:59.417799 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:59.417766 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" event={"ID":"a3515d5a-549a-4847-8f68-b7bbbd50f253","Type":"ContainerStarted","Data":"23e0ecb68452abc7267a1d527025b4e62234719cb66c3cd310a231c15441b77e"} Jun 15 01:47:59.434686 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:47:59.434616 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-spqwx" podStartSLOduration=1.555144152 podStartE2EDuration="4.434596455s" totalImagesPullingTime="2.879452303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:47:59.432909636 +0000 UTC m=+555.283840471" watchObservedRunningTime="2026-06-15 01:47:59.434596455 +0000 UTC m=+555.285527290" Jun 15 01:48:03.970478 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:03.970440 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm"] Jun 15 01:48:03.973387 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:03.973372 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" Jun 15 01:48:03.975511 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:03.975490 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:48:03.975665 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:03.975651 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gxzsj\"" Jun 15 01:48:03.975719 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:03.975706 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 01:48:03.981533 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:03.981509 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm"] Jun 15 01:48:04.111076 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.111052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5277361a-0c3a-42a2-9091-e6952a2a39eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rkgrm\" (UID: \"5277361a-0c3a-42a2-9091-e6952a2a39eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" Jun 15 01:48:04.111196 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.111086 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r87p4\" (UniqueName: \"kubernetes.io/projected/5277361a-0c3a-42a2-9091-e6952a2a39eb-kube-api-access-r87p4\") pod \"openshift-lws-operator-fd8ccff4c-rkgrm\" (UID: \"5277361a-0c3a-42a2-9091-e6952a2a39eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" Jun 15 01:48:04.211927 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.211901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5277361a-0c3a-42a2-9091-e6952a2a39eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rkgrm\" (UID: \"5277361a-0c3a-42a2-9091-e6952a2a39eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" Jun 15 01:48:04.212029 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.211934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r87p4\" (UniqueName: \"kubernetes.io/projected/5277361a-0c3a-42a2-9091-e6952a2a39eb-kube-api-access-r87p4\") pod \"openshift-lws-operator-fd8ccff4c-rkgrm\" (UID: \"5277361a-0c3a-42a2-9091-e6952a2a39eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" Jun 15 01:48:04.212324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.212305 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5277361a-0c3a-42a2-9091-e6952a2a39eb-tmp\") pod \"openshift-lws-operator-fd8ccff4c-rkgrm\" (UID: \"5277361a-0c3a-42a2-9091-e6952a2a39eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" Jun 15 01:48:04.221047 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.220993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r87p4\" (UniqueName: \"kubernetes.io/projected/5277361a-0c3a-42a2-9091-e6952a2a39eb-kube-api-access-r87p4\") pod \"openshift-lws-operator-fd8ccff4c-rkgrm\" (UID: \"5277361a-0c3a-42a2-9091-e6952a2a39eb\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" Jun 15 01:48:04.282817 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.282771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" Jun 15 01:48:04.408003 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.407975 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm"] Jun 15 01:48:04.411187 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:48:04.411163 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5277361a_0c3a_42a2_9091_e6952a2a39eb.slice/crio-18c67d1ed7d3034112cceb17c3155e587c34c0ce667e10c8ed62e18bbcb35f34 WatchSource:0}: Error finding container 18c67d1ed7d3034112cceb17c3155e587c34c0ce667e10c8ed62e18bbcb35f34: Status 404 returned error can't find the container with id 18c67d1ed7d3034112cceb17c3155e587c34c0ce667e10c8ed62e18bbcb35f34 Jun 15 01:48:04.437261 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:04.437238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" event={"ID":"5277361a-0c3a-42a2-9091-e6952a2a39eb","Type":"ContainerStarted","Data":"18c67d1ed7d3034112cceb17c3155e587c34c0ce667e10c8ed62e18bbcb35f34"} Jun 15 01:48:06.776143 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.776114 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f6649dcb9-lsgpn"] Jun 15 01:48:06.783591 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.783572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.792361 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.792250 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6649dcb9-lsgpn"] Jun 15 01:48:06.831771 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.831737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-trusted-ca-bundle\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.831771 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.831773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vtxb\" (UniqueName: \"kubernetes.io/projected/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-kube-api-access-9vtxb\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.831968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.831796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-service-ca\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.831968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.831854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-config\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.831968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.831877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-serving-cert\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.831968 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.831913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-oauth-serving-cert\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.832115 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.831978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-oauth-config\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.932591 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.932561 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-oauth-serving-cert\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.932761 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.932606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-oauth-config\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.932761 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.932660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-trusted-ca-bundle\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.932761 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.932675 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vtxb\" (UniqueName: \"kubernetes.io/projected/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-kube-api-access-9vtxb\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.932761 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.932693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-service-ca\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.932761 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.932715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-config\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.932761 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.932740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-serving-cert\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.933483 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.933423 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-oauth-serving-cert\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.933606 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.933487 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-service-ca\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.933718 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.933660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-trusted-ca-bundle\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.933718 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.933702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-config\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.935406 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.935386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-serving-cert\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.935511 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.935494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-console-oauth-config\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:06.940591 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:06.940569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vtxb\" (UniqueName: \"kubernetes.io/projected/153a3afd-2ff6-48ff-ba95-df017b6bc9b0-kube-api-access-9vtxb\") pod \"console-5f6649dcb9-lsgpn\" (UID: \"153a3afd-2ff6-48ff-ba95-df017b6bc9b0\") " pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:07.097803 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:07.097770 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:07.353928 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:07.353900 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f6649dcb9-lsgpn"] Jun 15 01:48:07.356614 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:48:07.356585 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod153a3afd_2ff6_48ff_ba95_df017b6bc9b0.slice/crio-cf7ad2069416780d00e7094912b44c4edb268d6ae28ccc62e767c4e3a632fd58 WatchSource:0}: Error finding container cf7ad2069416780d00e7094912b44c4edb268d6ae28ccc62e767c4e3a632fd58: Status 404 returned error can't find the container with id cf7ad2069416780d00e7094912b44c4edb268d6ae28ccc62e767c4e3a632fd58 Jun 15 01:48:07.450770 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:07.450734 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" event={"ID":"5277361a-0c3a-42a2-9091-e6952a2a39eb","Type":"ContainerStarted","Data":"45ae3d936e40798f6bf69f3b4bd0fbce13e08daf9f9c6a87e1c3f17952e52072"} Jun 15 01:48:07.452361 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:07.452334 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6649dcb9-lsgpn" event={"ID":"153a3afd-2ff6-48ff-ba95-df017b6bc9b0","Type":"ContainerStarted","Data":"62ad462899f327686f708c958c3821b7a6dfeae8a781d468e46803e621e77ab2"} Jun 15 01:48:07.452485 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:07.452373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f6649dcb9-lsgpn" event={"ID":"153a3afd-2ff6-48ff-ba95-df017b6bc9b0","Type":"ContainerStarted","Data":"cf7ad2069416780d00e7094912b44c4edb268d6ae28ccc62e767c4e3a632fd58"} Jun 15 01:48:07.465450 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:07.465380 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-rkgrm" podStartSLOduration=1.580976859 podStartE2EDuration="4.465360446s" totalImagesPullingTime="2.884383587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:07.465083758 +0000 UTC m=+563.316014608" watchObservedRunningTime="2026-06-15 01:48:07.465360446 +0000 UTC m=+563.316291281" Jun 15 01:48:07.485845 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:07.485802 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f6649dcb9-lsgpn" podStartSLOduration=1.485785079 podStartE2EDuration="1.485785079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:07.484965417 +0000 UTC m=+563.335896252" watchObservedRunningTime="2026-06-15 01:48:07.485785079 +0000 UTC m=+563.336715915" Jun 15 01:48:17.098324 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:17.098286 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:17.098924 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:17.098360 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:17.102595 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:17.102576 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:17.498998 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:17.498923 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f6649dcb9-lsgpn" Jun 15 01:48:17.540142 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:17.540112 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c48f898dd-mm4zh"] Jun 15 01:48:32.926168 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:32.926135 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z"] Jun 15 01:48:32.928665 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:32.928627 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:32.930778 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:32.930736 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 01:48:32.930778 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:32.930765 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7gcdp\"" Jun 15 01:48:32.930998 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:32.930765 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 01:48:32.931140 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:32.931125 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 01:48:32.931218 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:32.931170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 01:48:32.947536 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:32.947517 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z"] Jun 15 01:48:33.019749 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.019720 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtkpn\" (UniqueName: \"kubernetes.io/projected/843f1272-ea09-4044-ae70-4114c2abcff3-kube-api-access-vtkpn\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.019852 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.019784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/843f1272-ea09-4044-ae70-4114c2abcff3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.019852 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.019816 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/843f1272-ea09-4044-ae70-4114c2abcff3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.019933 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.019851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/843f1272-ea09-4044-ae70-4114c2abcff3-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.019933 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.019867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/843f1272-ea09-4044-ae70-4114c2abcff3-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.120434 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.120405 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtkpn\" (UniqueName: \"kubernetes.io/projected/843f1272-ea09-4044-ae70-4114c2abcff3-kube-api-access-vtkpn\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.120549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.120455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/843f1272-ea09-4044-ae70-4114c2abcff3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.120549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.120495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/843f1272-ea09-4044-ae70-4114c2abcff3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.120549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.120536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/843f1272-ea09-4044-ae70-4114c2abcff3-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.120749 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.120560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/843f1272-ea09-4044-ae70-4114c2abcff3-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.120964 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.120944 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/843f1272-ea09-4044-ae70-4114c2abcff3-manifests\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.122857 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.122828 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/843f1272-ea09-4044-ae70-4114c2abcff3-tmp\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.122962 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.122941 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/843f1272-ea09-4044-ae70-4114c2abcff3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.122962 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.122954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/843f1272-ea09-4044-ae70-4114c2abcff3-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.128688 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.128663 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtkpn\" (UniqueName: \"kubernetes.io/projected/843f1272-ea09-4044-ae70-4114c2abcff3-kube-api-access-vtkpn\") pod \"opendatahub-operator-controller-manager-5d6d6cd49-xfb5z\" (UID: \"843f1272-ea09-4044-ae70-4114c2abcff3\") " pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.241054 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.240997 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:33.367115 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.367079 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z"] Jun 15 01:48:33.371553 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:48:33.371526 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843f1272_ea09_4044_ae70_4114c2abcff3.slice/crio-f275e77980ef9c65d738c9e7c24d1a6b78e523df60bd52699904dcf3e12df513 WatchSource:0}: Error finding container f275e77980ef9c65d738c9e7c24d1a6b78e523df60bd52699904dcf3e12df513: Status 404 returned error can't find the container with id f275e77980ef9c65d738c9e7c24d1a6b78e523df60bd52699904dcf3e12df513 Jun 15 01:48:33.555191 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:33.555116 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" event={"ID":"843f1272-ea09-4044-ae70-4114c2abcff3","Type":"ContainerStarted","Data":"f275e77980ef9c65d738c9e7c24d1a6b78e523df60bd52699904dcf3e12df513"} Jun 15 01:48:36.568755 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:36.568677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" event={"ID":"843f1272-ea09-4044-ae70-4114c2abcff3","Type":"ContainerStarted","Data":"cacb71afb671909d142ca0e5bac197906151495c58c2e5e4d2e63f9d39058078"} Jun 15 01:48:37.573891 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:37.573859 2574 generic.go:356] "Generic (PLEG): container finished" podID="843f1272-ea09-4044-ae70-4114c2abcff3" containerID="cacb71afb671909d142ca0e5bac197906151495c58c2e5e4d2e63f9d39058078" exitCode=0 Jun 15 01:48:37.574254 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:37.573944 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" event={"ID":"843f1272-ea09-4044-ae70-4114c2abcff3","Type":"ContainerDied","Data":"cacb71afb671909d142ca0e5bac197906151495c58c2e5e4d2e63f9d39058078"} Jun 15 01:48:38.579920 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:38.579879 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" event={"ID":"843f1272-ea09-4044-ae70-4114c2abcff3","Type":"ContainerStarted","Data":"fb9ede8e909ed22b06926d2c8d7b2c39374c62430196bcbfcb8f8c9ebee890b9"} Jun 15 01:48:38.580295 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:38.580011 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:38.599388 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:38.599342 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" podStartSLOduration=2.394045453 podStartE2EDuration="6.599327914s" totalImagesPullingTime="3.236911491s" totalInitContainerRuntime="968.37097ms" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:38.598095732 +0000 UTC m=+594.449026602" watchObservedRunningTime="2026-06-15 01:48:38.599327914 +0000 UTC m=+594.450258747" Jun 15 01:48:42.561276 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.561233 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5c48f898dd-mm4zh" podUID="a613a341-9412-4923-8afa-fcb740e278f8" containerName="console" containerID="cri-o://77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789" gracePeriod=15 Jun 15 01:48:42.618916 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.618885 2574 patch_prober.go:28] interesting pod/console-5c48f898dd-mm4zh container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 15 01:48:42.619018 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.618945 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-5c48f898dd-mm4zh" podUID="a613a341-9412-4923-8afa-fcb740e278f8" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 15 01:48:42.799806 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.799781 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:48:42.903455 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903431 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-service-ca\") pod \"a613a341-9412-4923-8afa-fcb740e278f8\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " Jun 15 01:48:42.903573 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903463 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-serving-cert\") pod \"a613a341-9412-4923-8afa-fcb740e278f8\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " Jun 15 01:48:42.903573 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903488 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-trusted-ca-bundle\") pod \"a613a341-9412-4923-8afa-fcb740e278f8\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " Jun 15 01:48:42.903573 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903524 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-oauth-config\") pod \"a613a341-9412-4923-8afa-fcb740e278f8\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " Jun 15 01:48:42.903573 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903552 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-oauth-serving-cert\") pod \"a613a341-9412-4923-8afa-fcb740e278f8\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " Jun 15 01:48:42.903781 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903582 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qswv7\" (UniqueName: \"kubernetes.io/projected/a613a341-9412-4923-8afa-fcb740e278f8-kube-api-access-qswv7\") pod \"a613a341-9412-4923-8afa-fcb740e278f8\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " Jun 15 01:48:42.903781 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903608 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-console-config\") pod \"a613a341-9412-4923-8afa-fcb740e278f8\" (UID: \"a613a341-9412-4923-8afa-fcb740e278f8\") " Jun 15 01:48:42.903936 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903905 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a613a341-9412-4923-8afa-fcb740e278f8" (UID: "a613a341-9412-4923-8afa-fcb740e278f8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:48:42.904005 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.903957 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-service-ca" (OuterVolumeSpecName: "service-ca") pod "a613a341-9412-4923-8afa-fcb740e278f8" (UID: "a613a341-9412-4923-8afa-fcb740e278f8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:48:42.904061 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.904011 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a613a341-9412-4923-8afa-fcb740e278f8" (UID: "a613a341-9412-4923-8afa-fcb740e278f8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:48:42.904110 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.904089 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-console-config" (OuterVolumeSpecName: "console-config") pod "a613a341-9412-4923-8afa-fcb740e278f8" (UID: "a613a341-9412-4923-8afa-fcb740e278f8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:48:42.905781 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.905759 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a613a341-9412-4923-8afa-fcb740e278f8" (UID: "a613a341-9412-4923-8afa-fcb740e278f8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:48:42.905862 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.905783 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a613a341-9412-4923-8afa-fcb740e278f8" (UID: "a613a341-9412-4923-8afa-fcb740e278f8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:48:42.905862 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:42.905796 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a613a341-9412-4923-8afa-fcb740e278f8-kube-api-access-qswv7" (OuterVolumeSpecName: "kube-api-access-qswv7") pod "a613a341-9412-4923-8afa-fcb740e278f8" (UID: "a613a341-9412-4923-8afa-fcb740e278f8"). InnerVolumeSpecName "kube-api-access-qswv7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:48:43.004539 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.004519 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qswv7\" (UniqueName: \"kubernetes.io/projected/a613a341-9412-4923-8afa-fcb740e278f8-kube-api-access-qswv7\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:48:43.004539 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.004539 2574 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-console-config\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:48:43.004686 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.004549 2574 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-service-ca\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:48:43.004686 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.004559 2574 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-serving-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:48:43.004686 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.004567 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-trusted-ca-bundle\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:48:43.004686 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.004575 2574 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a613a341-9412-4923-8afa-fcb740e278f8-console-oauth-config\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:48:43.004686 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.004583 2574 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a613a341-9412-4923-8afa-fcb740e278f8-oauth-serving-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:48:43.600787 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.600756 2574 generic.go:356] "Generic (PLEG): container finished" podID="a613a341-9412-4923-8afa-fcb740e278f8" containerID="77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789" exitCode=0 Jun 15 01:48:43.601179 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.600797 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c48f898dd-mm4zh" Jun 15 01:48:43.601179 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.600809 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c48f898dd-mm4zh" event={"ID":"a613a341-9412-4923-8afa-fcb740e278f8","Type":"ContainerDied","Data":"77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789"} Jun 15 01:48:43.601179 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.600862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c48f898dd-mm4zh" event={"ID":"a613a341-9412-4923-8afa-fcb740e278f8","Type":"ContainerDied","Data":"20160f9274d92698e44418a58145edabe4f9c02747347fbcdf47b1b2e66612b6"} Jun 15 01:48:43.601179 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.600882 2574 scope.go:117] "RemoveContainer" containerID="77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789" Jun 15 01:48:43.609309 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.609293 2574 scope.go:117] "RemoveContainer" containerID="77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789" Jun 15 01:48:43.609582 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:48:43.609565 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789\": container with ID starting with 77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789 not found: ID does not exist" containerID="77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789" Jun 15 01:48:43.609625 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.609589 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789"} err="failed to get container status \"77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789\": rpc error: code = NotFound desc = could not find container \"77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789\": container with ID starting with 77037a29b58b1ec3ab3dd619b0539affd1460683fc76d561a8d6289778938789 not found: ID does not exist" Jun 15 01:48:43.623790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.623770 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c48f898dd-mm4zh"] Jun 15 01:48:43.627390 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:43.627371 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c48f898dd-mm4zh"] Jun 15 01:48:44.489811 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:44.489785 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:48:44.490574 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:44.490554 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:48:44.509012 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:44.508988 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a613a341-9412-4923-8afa-fcb740e278f8" path="/var/lib/kubelet/pods/a613a341-9412-4923-8afa-fcb740e278f8/volumes" Jun 15 01:48:49.586509 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:49.586479 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d6d6cd49-xfb5z" Jun 15 01:48:52.569017 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.568976 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-l9cfr"] Jun 15 01:48:52.570919 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.569361 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a613a341-9412-4923-8afa-fcb740e278f8" containerName="console" Jun 15 01:48:52.570919 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.569376 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="a613a341-9412-4923-8afa-fcb740e278f8" containerName="console" Jun 15 01:48:52.570919 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.569441 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="a613a341-9412-4923-8afa-fcb740e278f8" containerName="console" Jun 15 01:48:52.571414 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.571396 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:52.573420 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.573398 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 15 01:48:52.573532 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.573516 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ssgbd\"" Jun 15 01:48:52.584031 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.584013 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-l9cfr"] Jun 15 01:48:52.595095 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.595074 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-9566dff59-rc29d"] Jun 15 01:48:52.596979 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.596965 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.599358 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.599336 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 01:48:52.599451 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.599400 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 01:48:52.599511 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.599400 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 01:48:52.599704 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.599685 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 01:48:52.599785 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.599685 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-c72n6\"" Jun 15 01:48:52.605615 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.605581 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9566dff59-rc29d"] Jun 15 01:48:52.677528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.677092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn89k\" (UniqueName: \"kubernetes.io/projected/da391598-c62e-433a-a327-e91d5fddd760-kube-api-access-sn89k\") pod \"odh-model-controller-6dc94f689f-l9cfr\" (UID: \"da391598-c62e-433a-a327-e91d5fddd760\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:52.677528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.677134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m242v\" (UniqueName: \"kubernetes.io/projected/5864cd5c-f66b-48e2-afba-a762badfa76c-kube-api-access-m242v\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.677528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.677166 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da391598-c62e-433a-a327-e91d5fddd760-cert\") pod \"odh-model-controller-6dc94f689f-l9cfr\" (UID: \"da391598-c62e-433a-a327-e91d5fddd760\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:52.677528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.677244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5864cd5c-f66b-48e2-afba-a762badfa76c-tmp\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.677528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.677269 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5864cd5c-f66b-48e2-afba-a762badfa76c-tls-certs\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.778436 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.778402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5864cd5c-f66b-48e2-afba-a762badfa76c-tmp\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.778616 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.778449 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5864cd5c-f66b-48e2-afba-a762badfa76c-tls-certs\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.778616 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.778519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn89k\" (UniqueName: \"kubernetes.io/projected/da391598-c62e-433a-a327-e91d5fddd760-kube-api-access-sn89k\") pod \"odh-model-controller-6dc94f689f-l9cfr\" (UID: \"da391598-c62e-433a-a327-e91d5fddd760\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:52.778616 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.778546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m242v\" (UniqueName: \"kubernetes.io/projected/5864cd5c-f66b-48e2-afba-a762badfa76c-kube-api-access-m242v\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.778812 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.778722 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da391598-c62e-433a-a327-e91d5fddd760-cert\") pod \"odh-model-controller-6dc94f689f-l9cfr\" (UID: \"da391598-c62e-433a-a327-e91d5fddd760\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:52.778899 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:48:52.778879 2574 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 15 01:48:52.779121 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:48:52.779108 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da391598-c62e-433a-a327-e91d5fddd760-cert podName:da391598-c62e-433a-a327-e91d5fddd760 nodeName:}" failed. No retries permitted until 2026-06-15 01:48:53.279086144 +0000 UTC m=+609.130016959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/da391598-c62e-433a-a327-e91d5fddd760-cert") pod "odh-model-controller-6dc94f689f-l9cfr" (UID: "da391598-c62e-433a-a327-e91d5fddd760") : secret "odh-model-controller-webhook-cert" not found Jun 15 01:48:52.781065 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.781040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5864cd5c-f66b-48e2-afba-a762badfa76c-tmp\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.781294 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.781249 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5864cd5c-f66b-48e2-afba-a762badfa76c-tls-certs\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.786552 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.786533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn89k\" (UniqueName: \"kubernetes.io/projected/da391598-c62e-433a-a327-e91d5fddd760-kube-api-access-sn89k\") pod \"odh-model-controller-6dc94f689f-l9cfr\" (UID: \"da391598-c62e-433a-a327-e91d5fddd760\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:52.786868 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.786851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m242v\" (UniqueName: \"kubernetes.io/projected/5864cd5c-f66b-48e2-afba-a762badfa76c-kube-api-access-m242v\") pod \"kube-auth-proxy-9566dff59-rc29d\" (UID: \"5864cd5c-f66b-48e2-afba-a762badfa76c\") " pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:52.906749 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:52.906717 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" Jun 15 01:48:53.042505 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:48:53.042475 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5864cd5c_f66b_48e2_afba_a762badfa76c.slice/crio-58703a0071c0e8a7595cba219b8e0f6a5945a15232abd935347d41657cf8c13e WatchSource:0}: Error finding container 58703a0071c0e8a7595cba219b8e0f6a5945a15232abd935347d41657cf8c13e: Status 404 returned error can't find the container with id 58703a0071c0e8a7595cba219b8e0f6a5945a15232abd935347d41657cf8c13e Jun 15 01:48:53.049525 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.049500 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-9566dff59-rc29d"] Jun 15 01:48:53.224363 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.224273 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ds2sx"] Jun 15 01:48:53.227506 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.227477 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:53.229359 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.229339 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 15 01:48:53.229506 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.229486 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-jhzg6\"" Jun 15 01:48:53.237004 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.236915 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ds2sx"] Jun 15 01:48:53.282863 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.282830 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da391598-c62e-433a-a327-e91d5fddd760-cert\") pod \"odh-model-controller-6dc94f689f-l9cfr\" (UID: \"da391598-c62e-433a-a327-e91d5fddd760\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:53.285291 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.285270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/da391598-c62e-433a-a327-e91d5fddd760-cert\") pod \"odh-model-controller-6dc94f689f-l9cfr\" (UID: \"da391598-c62e-433a-a327-e91d5fddd760\") " pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:53.383708 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.383673 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-tls-certs\") pod \"model-serving-api-5dd488fc48-ds2sx\" (UID: \"d74e5b29-ba43-4255-b1cc-bab27b09dc6a\") " pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:53.383708 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.383713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dj4n9\" (UniqueName: \"kubernetes.io/projected/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-kube-api-access-dj4n9\") pod \"model-serving-api-5dd488fc48-ds2sx\" (UID: \"d74e5b29-ba43-4255-b1cc-bab27b09dc6a\") " pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:53.483154 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.483058 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:53.484327 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.484299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-tls-certs\") pod \"model-serving-api-5dd488fc48-ds2sx\" (UID: \"d74e5b29-ba43-4255-b1cc-bab27b09dc6a\") " pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:53.484459 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.484333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dj4n9\" (UniqueName: \"kubernetes.io/projected/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-kube-api-access-dj4n9\") pod \"model-serving-api-5dd488fc48-ds2sx\" (UID: \"d74e5b29-ba43-4255-b1cc-bab27b09dc6a\") " pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:53.484459 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:48:53.484442 2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 15 01:48:53.484574 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:48:53.484498 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-tls-certs podName:d74e5b29-ba43-4255-b1cc-bab27b09dc6a nodeName:}" failed. No retries permitted until 2026-06-15 01:48:53.984482426 +0000 UTC m=+609.835413238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-tls-certs") pod "model-serving-api-5dd488fc48-ds2sx" (UID: "d74e5b29-ba43-4255-b1cc-bab27b09dc6a") : secret "model-serving-api-tls" not found Jun 15 01:48:53.495737 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.495713 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dj4n9\" (UniqueName: \"kubernetes.io/projected/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-kube-api-access-dj4n9\") pod \"model-serving-api-5dd488fc48-ds2sx\" (UID: \"d74e5b29-ba43-4255-b1cc-bab27b09dc6a\") " pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:53.609197 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.609168 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-l9cfr"] Jun 15 01:48:53.611943 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:48:53.611917 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda391598_c62e_433a_a327_e91d5fddd760.slice/crio-fbed0984f441dc8edf8391dbc47fa117a8a66529223b3d1389d3b4133600c327 WatchSource:0}: Error finding container fbed0984f441dc8edf8391dbc47fa117a8a66529223b3d1389d3b4133600c327: Status 404 returned error can't find the container with id fbed0984f441dc8edf8391dbc47fa117a8a66529223b3d1389d3b4133600c327 Jun 15 01:48:53.642059 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.642023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" event={"ID":"5864cd5c-f66b-48e2-afba-a762badfa76c","Type":"ContainerStarted","Data":"58703a0071c0e8a7595cba219b8e0f6a5945a15232abd935347d41657cf8c13e"} Jun 15 01:48:53.643193 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.643172 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" event={"ID":"da391598-c62e-433a-a327-e91d5fddd760","Type":"ContainerStarted","Data":"fbed0984f441dc8edf8391dbc47fa117a8a66529223b3d1389d3b4133600c327"} Jun 15 01:48:53.989405 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.989368 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-tls-certs\") pod \"model-serving-api-5dd488fc48-ds2sx\" (UID: \"d74e5b29-ba43-4255-b1cc-bab27b09dc6a\") " pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:53.992119 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:53.992095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d74e5b29-ba43-4255-b1cc-bab27b09dc6a-tls-certs\") pod \"model-serving-api-5dd488fc48-ds2sx\" (UID: \"d74e5b29-ba43-4255-b1cc-bab27b09dc6a\") " pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:54.139491 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:54.139459 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:54.312938 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:54.312910 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-ds2sx"] Jun 15 01:48:54.321609 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:48:54.316664 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74e5b29_ba43_4255_b1cc_bab27b09dc6a.slice/crio-52ea44cdb8f7ac09c90a056fb06c2ba2f6df79aebc449d0bc1970cb1b03f136a WatchSource:0}: Error finding container 52ea44cdb8f7ac09c90a056fb06c2ba2f6df79aebc449d0bc1970cb1b03f136a: Status 404 returned error can't find the container with id 52ea44cdb8f7ac09c90a056fb06c2ba2f6df79aebc449d0bc1970cb1b03f136a Jun 15 01:48:54.649427 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:54.649390 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" event={"ID":"d74e5b29-ba43-4255-b1cc-bab27b09dc6a","Type":"ContainerStarted","Data":"52ea44cdb8f7ac09c90a056fb06c2ba2f6df79aebc449d0bc1970cb1b03f136a"} Jun 15 01:48:58.671546 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:58.671355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" event={"ID":"da391598-c62e-433a-a327-e91d5fddd760","Type":"ContainerStarted","Data":"ef664b4d8bf12f8cdb87caf6bb68b1346b5abcfdb51afbb0aa2ddc707c699b1d"} Jun 15 01:48:58.671546 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:58.671425 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:48:58.672916 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:58.672893 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" event={"ID":"5864cd5c-f66b-48e2-afba-a762badfa76c","Type":"ContainerStarted","Data":"088057355e18f761bbf87b888a812c958aaa3c130bb4643ae4c2d5c937ebe80b"} Jun 15 01:48:58.674685 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:58.674657 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" event={"ID":"d74e5b29-ba43-4255-b1cc-bab27b09dc6a","Type":"ContainerStarted","Data":"abdf0ffb0237353ab809de8090805226b03ce82fe425780d3bc078b0965aebb5"} Jun 15 01:48:58.674820 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:58.674791 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:48:58.685847 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:58.685800 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" podStartSLOduration=1.942760923 podStartE2EDuration="6.6857862s" totalImagesPullingTime="4.743025277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:58.684911371 +0000 UTC m=+614.535842226" watchObservedRunningTime="2026-06-15 01:48:58.6857862 +0000 UTC m=+614.536717033" Jun 15 01:48:58.700863 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:58.700822 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-9566dff59-rc29d" podStartSLOduration=1.379477991 podStartE2EDuration="6.700807465s" totalImagesPullingTime="5.321329474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:58.699252847 +0000 UTC m=+614.550183691" watchObservedRunningTime="2026-06-15 01:48:58.700807465 +0000 UTC m=+614.551738301" Jun 15 01:48:58.714440 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:48:58.714392 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" podStartSLOduration=1.671045018 podStartE2EDuration="5.714363102s" totalImagesPullingTime="4.043318084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:48:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:48:58.71384899 +0000 UTC m=+614.564779846" watchObservedRunningTime="2026-06-15 01:48:58.714363102 +0000 UTC m=+614.565293937" Jun 15 01:49:02.899185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.899098 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lw7xn"] Jun 15 01:49:02.902274 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.902255 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:02.905100 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.905076 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 15 01:49:02.905222 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.905112 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vvv6q\"" Jun 15 01:49:02.914208 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.914172 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lw7xn"] Jun 15 01:49:02.916563 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.916545 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6"] Jun 15 01:49:02.919581 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.919561 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:02.921820 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.921797 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t6pdd\"" Jun 15 01:49:02.921908 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.921841 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 15 01:49:02.933116 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:02.933050 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6"] Jun 15 01:49:03.069758 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.069727 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm656\" (UniqueName: \"kubernetes.io/projected/0039cb41-569f-49b6-b972-32dffa5e1cd0-kube-api-access-dm656\") pod \"kserve-controller-manager-69fc866d76-lw7xn\" (UID: \"0039cb41-569f-49b6-b972-32dffa5e1cd0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:03.069906 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.069772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv7rv\" (UniqueName: \"kubernetes.io/projected/e4be65e0-70f1-4b12-afdc-37b373779651-kube-api-access-rv7rv\") pod \"llmisvc-controller-manager-864bfd7bc9-m8dl6\" (UID: \"e4be65e0-70f1-4b12-afdc-37b373779651\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:03.069906 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.069829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4be65e0-70f1-4b12-afdc-37b373779651-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m8dl6\" (UID: \"e4be65e0-70f1-4b12-afdc-37b373779651\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:03.069906 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.069862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0039cb41-569f-49b6-b972-32dffa5e1cd0-cert\") pod \"kserve-controller-manager-69fc866d76-lw7xn\" (UID: \"0039cb41-569f-49b6-b972-32dffa5e1cd0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:03.170259 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.170179 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0039cb41-569f-49b6-b972-32dffa5e1cd0-cert\") pod \"kserve-controller-manager-69fc866d76-lw7xn\" (UID: \"0039cb41-569f-49b6-b972-32dffa5e1cd0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:03.170259 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.170216 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm656\" (UniqueName: \"kubernetes.io/projected/0039cb41-569f-49b6-b972-32dffa5e1cd0-kube-api-access-dm656\") pod \"kserve-controller-manager-69fc866d76-lw7xn\" (UID: \"0039cb41-569f-49b6-b972-32dffa5e1cd0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:03.170259 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.170237 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv7rv\" (UniqueName: \"kubernetes.io/projected/e4be65e0-70f1-4b12-afdc-37b373779651-kube-api-access-rv7rv\") pod \"llmisvc-controller-manager-864bfd7bc9-m8dl6\" (UID: \"e4be65e0-70f1-4b12-afdc-37b373779651\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:03.170529 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.170297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4be65e0-70f1-4b12-afdc-37b373779651-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m8dl6\" (UID: \"e4be65e0-70f1-4b12-afdc-37b373779651\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:03.172718 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.172699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4be65e0-70f1-4b12-afdc-37b373779651-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m8dl6\" (UID: \"e4be65e0-70f1-4b12-afdc-37b373779651\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:03.172804 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.172703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0039cb41-569f-49b6-b972-32dffa5e1cd0-cert\") pod \"kserve-controller-manager-69fc866d76-lw7xn\" (UID: \"0039cb41-569f-49b6-b972-32dffa5e1cd0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:03.180126 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.180100 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm656\" (UniqueName: \"kubernetes.io/projected/0039cb41-569f-49b6-b972-32dffa5e1cd0-kube-api-access-dm656\") pod \"kserve-controller-manager-69fc866d76-lw7xn\" (UID: \"0039cb41-569f-49b6-b972-32dffa5e1cd0\") " pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:03.181091 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.181067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv7rv\" (UniqueName: \"kubernetes.io/projected/e4be65e0-70f1-4b12-afdc-37b373779651-kube-api-access-rv7rv\") pod \"llmisvc-controller-manager-864bfd7bc9-m8dl6\" (UID: \"e4be65e0-70f1-4b12-afdc-37b373779651\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:03.215552 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.215528 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:03.231554 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.231536 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:03.352351 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.352318 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-lw7xn"] Jun 15 01:49:03.356143 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:49:03.356119 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0039cb41_569f_49b6_b972_32dffa5e1cd0.slice/crio-95d77c1fa504e2990098a076aa090801db96ac7ce56a87e93f4d86346e6355b2 WatchSource:0}: Error finding container 95d77c1fa504e2990098a076aa090801db96ac7ce56a87e93f4d86346e6355b2: Status 404 returned error can't find the container with id 95d77c1fa504e2990098a076aa090801db96ac7ce56a87e93f4d86346e6355b2 Jun 15 01:49:03.373790 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.373765 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6"] Jun 15 01:49:03.375961 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:49:03.375936 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode4be65e0_70f1_4b12_afdc_37b373779651.slice/crio-559f7a590c325d2263ea00a4558c54f4ce737bae13fa4498fc883a2fc33adeb8 WatchSource:0}: Error finding container 559f7a590c325d2263ea00a4558c54f4ce737bae13fa4498fc883a2fc33adeb8: Status 404 returned error can't find the container with id 559f7a590c325d2263ea00a4558c54f4ce737bae13fa4498fc883a2fc33adeb8 Jun 15 01:49:03.698633 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.698594 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" event={"ID":"0039cb41-569f-49b6-b972-32dffa5e1cd0","Type":"ContainerStarted","Data":"95d77c1fa504e2990098a076aa090801db96ac7ce56a87e93f4d86346e6355b2"} Jun 15 01:49:03.699668 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:03.699617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" event={"ID":"e4be65e0-70f1-4b12-afdc-37b373779651","Type":"ContainerStarted","Data":"559f7a590c325d2263ea00a4558c54f4ce737bae13fa4498fc883a2fc33adeb8"} Jun 15 01:49:06.567362 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.567326 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4rms5"] Jun 15 01:49:06.570809 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.570788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:06.573308 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.573283 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 15 01:49:06.573836 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.573816 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-ntgfg\"" Jun 15 01:49:06.573927 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.573844 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 15 01:49:06.585785 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.585764 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4rms5"] Jun 15 01:49:06.600399 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.600375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw4s8\" (UniqueName: \"kubernetes.io/projected/1bb2a933-ebda-4f0d-98a2-a1de825c528b-kube-api-access-qw4s8\") pod \"servicemesh-operator3-57f65f65fb-4rms5\" (UID: \"1bb2a933-ebda-4f0d-98a2-a1de825c528b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:06.600528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.600497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1bb2a933-ebda-4f0d-98a2-a1de825c528b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4rms5\" (UID: \"1bb2a933-ebda-4f0d-98a2-a1de825c528b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:06.701034 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.701000 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw4s8\" (UniqueName: \"kubernetes.io/projected/1bb2a933-ebda-4f0d-98a2-a1de825c528b-kube-api-access-qw4s8\") pod \"servicemesh-operator3-57f65f65fb-4rms5\" (UID: \"1bb2a933-ebda-4f0d-98a2-a1de825c528b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:06.701212 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.701096 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1bb2a933-ebda-4f0d-98a2-a1de825c528b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4rms5\" (UID: \"1bb2a933-ebda-4f0d-98a2-a1de825c528b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:06.703854 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.703817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/1bb2a933-ebda-4f0d-98a2-a1de825c528b-operator-config\") pod \"servicemesh-operator3-57f65f65fb-4rms5\" (UID: \"1bb2a933-ebda-4f0d-98a2-a1de825c528b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:06.712226 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.712199 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw4s8\" (UniqueName: \"kubernetes.io/projected/1bb2a933-ebda-4f0d-98a2-a1de825c528b-kube-api-access-qw4s8\") pod \"servicemesh-operator3-57f65f65fb-4rms5\" (UID: \"1bb2a933-ebda-4f0d-98a2-a1de825c528b\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:06.881362 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:06.881328 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:07.115664 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:07.115611 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-4rms5"] Jun 15 01:49:07.116590 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:49:07.116556 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb2a933_ebda_4f0d_98a2_a1de825c528b.slice/crio-997eb3300166c10d80e4296977e7fa173c28d3241e40f26f5f74efc8d913e09c WatchSource:0}: Error finding container 997eb3300166c10d80e4296977e7fa173c28d3241e40f26f5f74efc8d913e09c: Status 404 returned error can't find the container with id 997eb3300166c10d80e4296977e7fa173c28d3241e40f26f5f74efc8d913e09c Jun 15 01:49:07.720050 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:07.720018 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" event={"ID":"0039cb41-569f-49b6-b972-32dffa5e1cd0","Type":"ContainerStarted","Data":"a0badfec4f0b19e25a53031ec24e37c4b5962bb2261e7aa5245d0006ac463721"} Jun 15 01:49:07.720475 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:07.720104 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:49:07.721668 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:07.721629 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" event={"ID":"1bb2a933-ebda-4f0d-98a2-a1de825c528b","Type":"ContainerStarted","Data":"997eb3300166c10d80e4296977e7fa173c28d3241e40f26f5f74efc8d913e09c"} Jun 15 01:49:07.723146 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:07.723126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" event={"ID":"e4be65e0-70f1-4b12-afdc-37b373779651","Type":"ContainerStarted","Data":"b8ca52687e582c1c98993ecb85788bba2dd5f89dad9bd4b432980b3043909182"} Jun 15 01:49:07.723265 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:07.723242 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:07.760452 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:07.760409 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" podStartSLOduration=2.170364157 podStartE2EDuration="5.760396821s" totalImagesPullingTime="3.590032664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:07.758918016 +0000 UTC m=+623.609848871" watchObservedRunningTime="2026-06-15 01:49:07.760396821 +0000 UTC m=+623.611327654" Jun 15 01:49:07.791525 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:07.791483 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" podStartSLOduration=2.214764197 podStartE2EDuration="5.791471679s" totalImagesPullingTime="3.576707482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:07.79060591 +0000 UTC m=+623.641536743" watchObservedRunningTime="2026-06-15 01:49:07.791471679 +0000 UTC m=+623.642402512" Jun 15 01:49:09.200321 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.200288 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-845d6f7cf8-46cch"] Jun 15 01:49:09.206256 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.206235 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" Jun 15 01:49:09.209007 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.208927 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zbhdc\"" Jun 15 01:49:09.209547 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.209527 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 01:49:09.214128 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.214108 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-845d6f7cf8-46cch"] Jun 15 01:49:09.222283 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.222263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcltv\" (UniqueName: \"kubernetes.io/projected/e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e-kube-api-access-fcltv\") pod \"dashboard-redirect-845d6f7cf8-46cch\" (UID: \"e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" Jun 15 01:49:09.222376 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.222301 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e-redirect-config\") pod \"dashboard-redirect-845d6f7cf8-46cch\" (UID: \"e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" Jun 15 01:49:09.322942 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.322908 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcltv\" (UniqueName: \"kubernetes.io/projected/e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e-kube-api-access-fcltv\") pod \"dashboard-redirect-845d6f7cf8-46cch\" (UID: \"e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" Jun 15 01:49:09.323078 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.322953 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e-redirect-config\") pod \"dashboard-redirect-845d6f7cf8-46cch\" (UID: \"e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" Jun 15 01:49:09.323714 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.323693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e-redirect-config\") pod \"dashboard-redirect-845d6f7cf8-46cch\" (UID: \"e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" Jun 15 01:49:09.332052 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.332022 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcltv\" (UniqueName: \"kubernetes.io/projected/e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e-kube-api-access-fcltv\") pod \"dashboard-redirect-845d6f7cf8-46cch\" (UID: \"e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e\") " pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" Jun 15 01:49:09.519619 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.519550 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" Jun 15 01:49:09.664587 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.664562 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-845d6f7cf8-46cch"] Jun 15 01:49:09.667739 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:49:09.667701 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4fa8ba6_ccd8_42bd_a83f_50aefe83e59e.slice/crio-27306735f594ae8e6d46e8178df14d50f285946a1695d289757a25f0a9e19e91 WatchSource:0}: Error finding container 27306735f594ae8e6d46e8178df14d50f285946a1695d289757a25f0a9e19e91: Status 404 returned error can't find the container with id 27306735f594ae8e6d46e8178df14d50f285946a1695d289757a25f0a9e19e91 Jun 15 01:49:09.681580 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.681558 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-l9cfr" Jun 15 01:49:09.683683 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.683665 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-ds2sx" Jun 15 01:49:09.738017 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:09.737961 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" event={"ID":"e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e","Type":"ContainerStarted","Data":"27306735f594ae8e6d46e8178df14d50f285946a1695d289757a25f0a9e19e91"} Jun 15 01:49:11.750818 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:11.750749 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" event={"ID":"1bb2a933-ebda-4f0d-98a2-a1de825c528b","Type":"ContainerStarted","Data":"98b0d9e4976514f9d41f8ea223d87d2a6ae4b89c35d93e93933f6aede33727b1"} Jun 15 01:49:11.751407 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:11.751379 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:11.776213 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:11.776168 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" podStartSLOduration=1.6683082219999998 podStartE2EDuration="5.776153092s" totalImagesPullingTime="4.10784487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:11.770052544 +0000 UTC m=+627.620983378" watchObservedRunningTime="2026-06-15 01:49:11.776153092 +0000 UTC m=+627.627083928" Jun 15 01:49:12.757056 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:12.757025 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" event={"ID":"e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e","Type":"ContainerStarted","Data":"01be4ae7744905188731b1da7f2ec93902550419f3f79d4e4205ae96e9e2c2e7"} Jun 15 01:49:12.772150 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:12.772109 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-845d6f7cf8-46cch" podStartSLOduration=0.856807895 podStartE2EDuration="3.77209548s" totalImagesPullingTime="2.915287585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:12.770658817 +0000 UTC m=+628.621589645" watchObservedRunningTime="2026-06-15 01:49:12.77209548 +0000 UTC m=+628.623026313" Jun 15 01:49:22.301123 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.301094 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4"] Jun 15 01:49:22.305687 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.305670 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.307705 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.307682 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 15 01:49:22.307907 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.307882 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 01:49:22.308006 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.307900 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 15 01:49:22.308006 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.307952 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 15 01:49:22.308006 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.307995 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jqv9g\"" Jun 15 01:49:22.314824 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.314801 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4"] Jun 15 01:49:22.327676 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.327621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.327770 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.327740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.327830 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.327812 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.327881 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.327868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1206a6-8186-498b-b2a8-797993bbe1e5-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.327926 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.327897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.327962 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.327922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wczm8\" (UniqueName: \"kubernetes.io/projected/af1206a6-8186-498b-b2a8-797993bbe1e5-kube-api-access-wczm8\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.327962 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.327954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.428538 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.428504 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.428737 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.428563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.428737 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.428606 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1206a6-8186-498b-b2a8-797993bbe1e5-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.428737 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.428629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.428737 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.428679 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wczm8\" (UniqueName: \"kubernetes.io/projected/af1206a6-8186-498b-b2a8-797993bbe1e5-kube-api-access-wczm8\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.428737 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.428713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.429005 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.428744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.429363 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.429336 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.431117 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.431096 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.431311 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.431292 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.431377 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.431360 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/af1206a6-8186-498b-b2a8-797993bbe1e5-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.431565 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.431544 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.435716 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.435693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wczm8\" (UniqueName: \"kubernetes.io/projected/af1206a6-8186-498b-b2a8-797993bbe1e5-kube-api-access-wczm8\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.435797 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.435737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af1206a6-8186-498b-b2a8-797993bbe1e5-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-75wh4\" (UID: \"af1206a6-8186-498b-b2a8-797993bbe1e5\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.616466 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.616443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:22.749294 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.749270 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4"] Jun 15 01:49:22.751648 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:49:22.751613 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1206a6_8186_498b_b2a8_797993bbe1e5.slice/crio-76443756c005a1612d437ac480d13f7e0b69064032a7410c353705a67d4bc313 WatchSource:0}: Error finding container 76443756c005a1612d437ac480d13f7e0b69064032a7410c353705a67d4bc313: Status 404 returned error can't find the container with id 76443756c005a1612d437ac480d13f7e0b69064032a7410c353705a67d4bc313 Jun 15 01:49:22.802782 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:22.802745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" event={"ID":"af1206a6-8186-498b-b2a8-797993bbe1e5","Type":"ContainerStarted","Data":"76443756c005a1612d437ac480d13f7e0b69064032a7410c353705a67d4bc313"} Jun 15 01:49:23.764358 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:23.764330 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-4rms5" Jun 15 01:49:25.346816 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:25.346765 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 01:49:25.347100 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:25.346836 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 15 01:49:25.819704 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:25.819603 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" event={"ID":"af1206a6-8186-498b-b2a8-797993bbe1e5","Type":"ContainerStarted","Data":"2f0ded18e635c61aefc6ae522d3d1d801471242b9f4cd8f1b955ff9d7d4a0274"} Jun 15 01:49:25.819863 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:25.819742 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:26.826227 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:26.826197 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" Jun 15 01:49:26.851960 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:26.850512 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-75wh4" podStartSLOduration=2.257789229 podStartE2EDuration="4.850490088s" totalImagesPullingTime="2.592700859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:49:25.837470239 +0000 UTC m=+641.688401074" watchObservedRunningTime="2026-06-15 01:49:26.850490088 +0000 UTC m=+642.701420923" Jun 15 01:49:38.731861 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:38.731828 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m8dl6" Jun 15 01:49:38.734760 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:49:38.734735 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-lw7xn" Jun 15 01:50:47.746799 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.746763 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5"] Jun 15 01:50:47.749345 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.749325 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" Jun 15 01:50:47.751694 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.751670 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2ngj9\"" Jun 15 01:50:47.752075 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.751938 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 01:50:47.752075 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.751958 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 01:50:47.768182 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.768161 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5"] Jun 15 01:50:47.850906 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.850880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h4ts\" (UniqueName: \"kubernetes.io/projected/7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00-kube-api-access-9h4ts\") pod \"limitador-operator-controller-manager-859d7b78bd-f64k5\" (UID: \"7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" Jun 15 01:50:47.951620 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.951597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h4ts\" (UniqueName: \"kubernetes.io/projected/7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00-kube-api-access-9h4ts\") pod \"limitador-operator-controller-manager-859d7b78bd-f64k5\" (UID: \"7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" Jun 15 01:50:47.968630 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:47.968599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h4ts\" (UniqueName: \"kubernetes.io/projected/7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00-kube-api-access-9h4ts\") pod \"limitador-operator-controller-manager-859d7b78bd-f64k5\" (UID: \"7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" Jun 15 01:50:48.060684 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:48.060608 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" Jun 15 01:50:48.182984 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:48.182959 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5"] Jun 15 01:50:48.185665 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:50:48.185629 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b95ec8f_f9cd_40e3_ab33_6d391dc9cf00.slice/crio-577a0e283e5799ebaf645f2f8d12a8242a3d270a77df256b8839185e5c110e16 WatchSource:0}: Error finding container 577a0e283e5799ebaf645f2f8d12a8242a3d270a77df256b8839185e5c110e16: Status 404 returned error can't find the container with id 577a0e283e5799ebaf645f2f8d12a8242a3d270a77df256b8839185e5c110e16 Jun 15 01:50:49.180880 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:49.180850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" event={"ID":"7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00","Type":"ContainerStarted","Data":"577a0e283e5799ebaf645f2f8d12a8242a3d270a77df256b8839185e5c110e16"} Jun 15 01:50:50.192249 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:50.192207 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" event={"ID":"7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00","Type":"ContainerStarted","Data":"014b05de9e528a9b8389218e7696a09c97a8f2f7fe451b412161a735a73a56f4"} Jun 15 01:50:50.192755 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:50.192307 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" Jun 15 01:50:50.209297 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:50:50.209254 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" podStartSLOduration=1.650679418 podStartE2EDuration="3.209240953s" totalImagesPullingTime="1.558561535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:50:50.208383379 +0000 UTC m=+726.059314276" watchObservedRunningTime="2026-06-15 01:50:50.209240953 +0000 UTC m=+726.060171798" Jun 15 01:51:01.198851 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:01.198818 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f64k5" Jun 15 01:51:44.083442 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.083407 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-srtp9"] Jun 15 01:51:44.086297 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.086270 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:44.088410 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.088383 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 15 01:51:44.092931 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.092906 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-srtp9"] Jun 15 01:51:44.203073 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.203047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b07ba3c8-1c01-4388-acd0-7723d494db7d-data\") pod \"postgres-69fb4594cf-srtp9\" (UID: \"b07ba3c8-1c01-4388-acd0-7723d494db7d\") " pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:44.203192 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.203083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlqn6\" (UniqueName: \"kubernetes.io/projected/b07ba3c8-1c01-4388-acd0-7723d494db7d-kube-api-access-zlqn6\") pod \"postgres-69fb4594cf-srtp9\" (UID: \"b07ba3c8-1c01-4388-acd0-7723d494db7d\") " pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:44.304302 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.304266 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b07ba3c8-1c01-4388-acd0-7723d494db7d-data\") pod \"postgres-69fb4594cf-srtp9\" (UID: \"b07ba3c8-1c01-4388-acd0-7723d494db7d\") " pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:44.304411 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.304313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlqn6\" (UniqueName: \"kubernetes.io/projected/b07ba3c8-1c01-4388-acd0-7723d494db7d-kube-api-access-zlqn6\") pod \"postgres-69fb4594cf-srtp9\" (UID: \"b07ba3c8-1c01-4388-acd0-7723d494db7d\") " pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:44.304702 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.304682 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b07ba3c8-1c01-4388-acd0-7723d494db7d-data\") pod \"postgres-69fb4594cf-srtp9\" (UID: \"b07ba3c8-1c01-4388-acd0-7723d494db7d\") " pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:44.312123 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.312102 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlqn6\" (UniqueName: \"kubernetes.io/projected/b07ba3c8-1c01-4388-acd0-7723d494db7d-kube-api-access-zlqn6\") pod \"postgres-69fb4594cf-srtp9\" (UID: \"b07ba3c8-1c01-4388-acd0-7723d494db7d\") " pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:44.399223 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.399174 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:44.527885 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:44.527825 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-srtp9"] Jun 15 01:51:44.530370 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:51:44.530345 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb07ba3c8_1c01_4388_acd0_7723d494db7d.slice/crio-b4f2fc9848ae8e106517ff66c062a9820d2193ca2e5bf8cec7a5a20131666b4b WatchSource:0}: Error finding container b4f2fc9848ae8e106517ff66c062a9820d2193ca2e5bf8cec7a5a20131666b4b: Status 404 returned error can't find the container with id b4f2fc9848ae8e106517ff66c062a9820d2193ca2e5bf8cec7a5a20131666b4b Jun 15 01:51:45.438577 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:45.438538 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-srtp9" event={"ID":"b07ba3c8-1c01-4388-acd0-7723d494db7d","Type":"ContainerStarted","Data":"b4f2fc9848ae8e106517ff66c062a9820d2193ca2e5bf8cec7a5a20131666b4b"} Jun 15 01:51:48.183529 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:48.183506 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 15 01:51:48.455733 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:48.455661 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-srtp9" event={"ID":"b07ba3c8-1c01-4388-acd0-7723d494db7d","Type":"ContainerStarted","Data":"5630b5c6b17dd5069b5bd692edcdacdd194f7a9fb0a8adb819487eaaa7c361fd"} Jun 15 01:51:48.455855 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:48.455786 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:51:48.470563 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:48.470481 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-srtp9" podStartSLOduration=0.820816084 podStartE2EDuration="4.47046228s" totalImagesPullingTime="3.649646196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:51:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:51:48.469523188 +0000 UTC m=+784.320454033" watchObservedRunningTime="2026-06-15 01:51:48.47046228 +0000 UTC m=+784.321393116" Jun 15 01:51:54.492003 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:51:54.491974 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-srtp9" Jun 15 01:52:58.619042 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.619010 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-df58656f6-gw7pg"] Jun 15 01:52:58.622525 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.622506 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:52:58.624748 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.624724 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 01:52:58.624748 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.624744 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 01:52:58.624919 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.624855 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f2lks\"" Jun 15 01:52:58.630398 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.630349 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-df58656f6-gw7pg"] Jun 15 01:52:58.662160 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.662138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hddfj\" (UniqueName: \"kubernetes.io/projected/abb85c40-5c14-4ef8-b0a6-66b744a0b367-kube-api-access-hddfj\") pod \"maas-controller-df58656f6-gw7pg\" (UID: \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\") " pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:52:58.662271 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.662182 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abb85c40-5c14-4ef8-b0a6-66b744a0b367-webhook-cert\") pod \"maas-controller-df58656f6-gw7pg\" (UID: \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\") " pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:52:58.762757 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.762735 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abb85c40-5c14-4ef8-b0a6-66b744a0b367-webhook-cert\") pod \"maas-controller-df58656f6-gw7pg\" (UID: \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\") " pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:52:58.762877 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.762798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hddfj\" (UniqueName: \"kubernetes.io/projected/abb85c40-5c14-4ef8-b0a6-66b744a0b367-kube-api-access-hddfj\") pod \"maas-controller-df58656f6-gw7pg\" (UID: \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\") " pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:52:58.765104 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.765086 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abb85c40-5c14-4ef8-b0a6-66b744a0b367-webhook-cert\") pod \"maas-controller-df58656f6-gw7pg\" (UID: \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\") " pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:52:58.770697 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.770678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hddfj\" (UniqueName: \"kubernetes.io/projected/abb85c40-5c14-4ef8-b0a6-66b744a0b367-kube-api-access-hddfj\") pod \"maas-controller-df58656f6-gw7pg\" (UID: \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\") " pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:52:58.794817 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.794793 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bfb858b88-h59qw"] Jun 15 01:52:58.797907 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.797891 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:52:58.814298 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.808515 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bfb858b88-h59qw"] Jun 15 01:52:58.864166 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.864140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/204f411a-dd52-4717-b530-8907f0ff4d82-webhook-cert\") pod \"maas-controller-5bfb858b88-h59qw\" (UID: \"204f411a-dd52-4717-b530-8907f0ff4d82\") " pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:52:58.864262 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.864171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9d69\" (UniqueName: \"kubernetes.io/projected/204f411a-dd52-4717-b530-8907f0ff4d82-kube-api-access-r9d69\") pod \"maas-controller-5bfb858b88-h59qw\" (UID: \"204f411a-dd52-4717-b530-8907f0ff4d82\") " pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:52:58.935227 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.935159 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:52:58.965329 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.965297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9d69\" (UniqueName: \"kubernetes.io/projected/204f411a-dd52-4717-b530-8907f0ff4d82-kube-api-access-r9d69\") pod \"maas-controller-5bfb858b88-h59qw\" (UID: \"204f411a-dd52-4717-b530-8907f0ff4d82\") " pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:52:58.965441 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.965420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/204f411a-dd52-4717-b530-8907f0ff4d82-webhook-cert\") pod \"maas-controller-5bfb858b88-h59qw\" (UID: \"204f411a-dd52-4717-b530-8907f0ff4d82\") " pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:52:58.967858 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.967835 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/204f411a-dd52-4717-b530-8907f0ff4d82-webhook-cert\") pod \"maas-controller-5bfb858b88-h59qw\" (UID: \"204f411a-dd52-4717-b530-8907f0ff4d82\") " pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:52:58.973695 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:58.973660 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9d69\" (UniqueName: \"kubernetes.io/projected/204f411a-dd52-4717-b530-8907f0ff4d82-kube-api-access-r9d69\") pod \"maas-controller-5bfb858b88-h59qw\" (UID: \"204f411a-dd52-4717-b530-8907f0ff4d82\") " pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:52:59.063035 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:59.062891 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-df58656f6-gw7pg"] Jun 15 01:52:59.065808 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:52:59.065778 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb85c40_5c14_4ef8_b0a6_66b744a0b367.slice/crio-4bf129c20a661afdf9338dbc2124c816a55cb2f78fc8c3f3c7c519a47a864a99 WatchSource:0}: Error finding container 4bf129c20a661afdf9338dbc2124c816a55cb2f78fc8c3f3c7c519a47a864a99: Status 404 returned error can't find the container with id 4bf129c20a661afdf9338dbc2124c816a55cb2f78fc8c3f3c7c519a47a864a99 Jun 15 01:52:59.067160 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:59.067140 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:52:59.110697 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:59.110675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:52:59.235766 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:59.235744 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bfb858b88-h59qw"] Jun 15 01:52:59.238066 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:52:59.238035 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204f411a_dd52_4717_b530_8907f0ff4d82.slice/crio-d6b9ee9d81d2ab2d236b689946486b008e0f9f6bb51aad2758cc5835f5d5c17c WatchSource:0}: Error finding container d6b9ee9d81d2ab2d236b689946486b008e0f9f6bb51aad2758cc5835f5d5c17c: Status 404 returned error can't find the container with id d6b9ee9d81d2ab2d236b689946486b008e0f9f6bb51aad2758cc5835f5d5c17c Jun 15 01:52:59.766052 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:59.766017 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb858b88-h59qw" event={"ID":"204f411a-dd52-4717-b530-8907f0ff4d82","Type":"ContainerStarted","Data":"d6b9ee9d81d2ab2d236b689946486b008e0f9f6bb51aad2758cc5835f5d5c17c"} Jun 15 01:52:59.767119 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:52:59.767094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-df58656f6-gw7pg" event={"ID":"abb85c40-5c14-4ef8-b0a6-66b744a0b367","Type":"ContainerStarted","Data":"4bf129c20a661afdf9338dbc2124c816a55cb2f78fc8c3f3c7c519a47a864a99"} Jun 15 01:53:01.780415 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:01.780385 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb858b88-h59qw" event={"ID":"204f411a-dd52-4717-b530-8907f0ff4d82","Type":"ContainerStarted","Data":"907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5"} Jun 15 01:53:01.780837 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:01.780486 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:53:01.781913 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:01.781894 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-df58656f6-gw7pg" event={"ID":"abb85c40-5c14-4ef8-b0a6-66b744a0b367","Type":"ContainerStarted","Data":"95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8"} Jun 15 01:53:01.782016 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:01.781938 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:53:01.796912 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:01.796867 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bfb858b88-h59qw" podStartSLOduration=2.259849456 podStartE2EDuration="3.796854603s" totalImagesPullingTime="1.537005147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:53:01.795711457 +0000 UTC m=+857.646642290" watchObservedRunningTime="2026-06-15 01:53:01.796854603 +0000 UTC m=+857.647785437" Jun 15 01:53:01.811056 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:01.811018 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-df58656f6-gw7pg" podStartSLOduration=2.09848769 podStartE2EDuration="3.81100677s" totalImagesPullingTime="1.71251908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:53:01.809604037 +0000 UTC m=+857.660534900" watchObservedRunningTime="2026-06-15 01:53:01.81100677 +0000 UTC m=+857.661937604" Jun 15 01:53:12.793199 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:12.793162 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:53:12.793603 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:12.793379 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:53:12.849268 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:12.849231 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-df58656f6-gw7pg"] Jun 15 01:53:12.849484 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:12.849430 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-df58656f6-gw7pg" podUID="abb85c40-5c14-4ef8-b0a6-66b744a0b367" containerName="manager" containerID="cri-o://95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8" gracePeriod=30 Jun 15 01:53:13.100653 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.100625 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:53:13.172302 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.172274 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hddfj\" (UniqueName: \"kubernetes.io/projected/abb85c40-5c14-4ef8-b0a6-66b744a0b367-kube-api-access-hddfj\") pod \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\" (UID: \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\") " Jun 15 01:53:13.172407 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.172351 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abb85c40-5c14-4ef8-b0a6-66b744a0b367-webhook-cert\") pod \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\" (UID: \"abb85c40-5c14-4ef8-b0a6-66b744a0b367\") " Jun 15 01:53:13.174379 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.174349 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb85c40-5c14-4ef8-b0a6-66b744a0b367-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "abb85c40-5c14-4ef8-b0a6-66b744a0b367" (UID: "abb85c40-5c14-4ef8-b0a6-66b744a0b367"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:53:13.174379 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.174349 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb85c40-5c14-4ef8-b0a6-66b744a0b367-kube-api-access-hddfj" (OuterVolumeSpecName: "kube-api-access-hddfj") pod "abb85c40-5c14-4ef8-b0a6-66b744a0b367" (UID: "abb85c40-5c14-4ef8-b0a6-66b744a0b367"). InnerVolumeSpecName "kube-api-access-hddfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:53:13.273052 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.273028 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hddfj\" (UniqueName: \"kubernetes.io/projected/abb85c40-5c14-4ef8-b0a6-66b744a0b367-kube-api-access-hddfj\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:53:13.273052 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.273051 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abb85c40-5c14-4ef8-b0a6-66b744a0b367-webhook-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:53:13.837983 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.837947 2574 generic.go:356] "Generic (PLEG): container finished" podID="abb85c40-5c14-4ef8-b0a6-66b744a0b367" containerID="95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8" exitCode=0 Jun 15 01:53:13.838428 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.837992 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-df58656f6-gw7pg" Jun 15 01:53:13.838428 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.838036 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-df58656f6-gw7pg" event={"ID":"abb85c40-5c14-4ef8-b0a6-66b744a0b367","Type":"ContainerDied","Data":"95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8"} Jun 15 01:53:13.838428 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.838092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-df58656f6-gw7pg" event={"ID":"abb85c40-5c14-4ef8-b0a6-66b744a0b367","Type":"ContainerDied","Data":"4bf129c20a661afdf9338dbc2124c816a55cb2f78fc8c3f3c7c519a47a864a99"} Jun 15 01:53:13.838428 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.838115 2574 scope.go:117] "RemoveContainer" containerID="95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8" Jun 15 01:53:13.846504 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.846485 2574 scope.go:117] "RemoveContainer" containerID="95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8" Jun 15 01:53:13.846769 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:53:13.846748 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8\": container with ID starting with 95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8 not found: ID does not exist" containerID="95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8" Jun 15 01:53:13.846857 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.846776 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8"} err="failed to get container status \"95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8\": rpc error: code = NotFound desc = could not find container \"95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8\": container with ID starting with 95dce2669e8e22db16e9c9d537e04b2296af81ffccf521a1a654c74f1db709e8 not found: ID does not exist" Jun 15 01:53:13.859880 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.859859 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-df58656f6-gw7pg"] Jun 15 01:53:13.863485 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:13.863464 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-df58656f6-gw7pg"] Jun 15 01:53:14.509476 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:14.509449 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb85c40-5c14-4ef8-b0a6-66b744a0b367" path="/var/lib/kubelet/pods/abb85c40-5c14-4ef8-b0a6-66b744a0b367/volumes" Jun 15 01:53:30.202922 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.202829 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7b64764fc8-hmgj7"] Jun 15 01:53:30.203456 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.203317 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb85c40-5c14-4ef8-b0a6-66b744a0b367" containerName="manager" Jun 15 01:53:30.203456 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.203333 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb85c40-5c14-4ef8-b0a6-66b744a0b367" containerName="manager" Jun 15 01:53:30.203456 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.203409 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb85c40-5c14-4ef8-b0a6-66b744a0b367" containerName="manager" Jun 15 01:53:30.208040 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.208015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.210165 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.210141 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 15 01:53:30.210269 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.210192 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rmwdg\"" Jun 15 01:53:30.214458 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.214435 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b64764fc8-hmgj7"] Jun 15 01:53:30.301849 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.301821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a64029-2a54-4056-9b6f-d572dcbcc337-maas-api-tls\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.301957 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.301858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs7wv\" (UniqueName: \"kubernetes.io/projected/84a64029-2a54-4056-9b6f-d572dcbcc337-kube-api-access-xs7wv\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.301957 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.301897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a64029-2a54-4056-9b6f-d572dcbcc337-openshift-service-ca\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.403116 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.403088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a64029-2a54-4056-9b6f-d572dcbcc337-maas-api-tls\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.403250 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.403142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs7wv\" (UniqueName: \"kubernetes.io/projected/84a64029-2a54-4056-9b6f-d572dcbcc337-kube-api-access-xs7wv\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.403250 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.403200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a64029-2a54-4056-9b6f-d572dcbcc337-openshift-service-ca\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.403610 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:53:30.403553 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 15 01:53:30.403733 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:53:30.403691 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84a64029-2a54-4056-9b6f-d572dcbcc337-maas-api-tls podName:84a64029-2a54-4056-9b6f-d572dcbcc337 nodeName:}" failed. No retries permitted until 2026-06-15 01:53:30.90367115 +0000 UTC m=+886.754601969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/84a64029-2a54-4056-9b6f-d572dcbcc337-maas-api-tls") pod "maas-api-7b64764fc8-hmgj7" (UID: "84a64029-2a54-4056-9b6f-d572dcbcc337") : secret "maas-api-serving-cert" not found Jun 15 01:53:30.403884 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.403867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84a64029-2a54-4056-9b6f-d572dcbcc337-openshift-service-ca\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.410962 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.410941 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs7wv\" (UniqueName: \"kubernetes.io/projected/84a64029-2a54-4056-9b6f-d572dcbcc337-kube-api-access-xs7wv\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.688991 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.688957 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-z8qkb"] Jun 15 01:53:30.692394 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.692374 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" Jun 15 01:53:30.694777 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.694757 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 01:53:30.694864 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.694826 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g274t\"" Jun 15 01:53:30.703036 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.703016 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-z8qkb"] Jun 15 01:53:30.718084 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.718061 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-4wb5x"] Jun 15 01:53:30.721160 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.721144 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" Jun 15 01:53:30.729511 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.729423 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-4wb5x"] Jun 15 01:53:30.806561 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.806530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zmnk\" (UniqueName: \"kubernetes.io/projected/ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d-kube-api-access-8zmnk\") pod \"payload-processing-699b6cd6c-4wb5x\" (UID: \"ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d\") " pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" Jun 15 01:53:30.806749 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.806575 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2hrd\" (UniqueName: \"kubernetes.io/projected/7c603aab-fc77-4813-9a96-aaa351963e47-kube-api-access-s2hrd\") pod \"payload-pre-processing-579785bc64-z8qkb\" (UID: \"7c603aab-fc77-4813-9a96-aaa351963e47\") " pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" Jun 15 01:53:30.907540 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.907510 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zmnk\" (UniqueName: \"kubernetes.io/projected/ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d-kube-api-access-8zmnk\") pod \"payload-processing-699b6cd6c-4wb5x\" (UID: \"ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d\") " pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" Jun 15 01:53:30.907758 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.907565 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2hrd\" (UniqueName: \"kubernetes.io/projected/7c603aab-fc77-4813-9a96-aaa351963e47-kube-api-access-s2hrd\") pod \"payload-pre-processing-579785bc64-z8qkb\" (UID: \"7c603aab-fc77-4813-9a96-aaa351963e47\") " pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" Jun 15 01:53:30.907758 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.907613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a64029-2a54-4056-9b6f-d572dcbcc337-maas-api-tls\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.910137 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.910112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84a64029-2a54-4056-9b6f-d572dcbcc337-maas-api-tls\") pod \"maas-api-7b64764fc8-hmgj7\" (UID: \"84a64029-2a54-4056-9b6f-d572dcbcc337\") " pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:30.915198 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.915171 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2hrd\" (UniqueName: \"kubernetes.io/projected/7c603aab-fc77-4813-9a96-aaa351963e47-kube-api-access-s2hrd\") pod \"payload-pre-processing-579785bc64-z8qkb\" (UID: \"7c603aab-fc77-4813-9a96-aaa351963e47\") " pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" Jun 15 01:53:30.915307 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:30.915245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zmnk\" (UniqueName: \"kubernetes.io/projected/ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d-kube-api-access-8zmnk\") pod \"payload-processing-699b6cd6c-4wb5x\" (UID: \"ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d\") " pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" Jun 15 01:53:31.004044 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.003985 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" Jun 15 01:53:31.032044 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.031993 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" Jun 15 01:53:31.137038 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.137011 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:31.147895 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.147870 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-z8qkb"] Jun 15 01:53:31.151262 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:53:31.151239 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c603aab_fc77_4813_9a96_aaa351963e47.slice/crio-77b2d0bb1f607dd8077d2364c5aa4e4d1e18d281238b514c534c835698b05bb6 WatchSource:0}: Error finding container 77b2d0bb1f607dd8077d2364c5aa4e4d1e18d281238b514c534c835698b05bb6: Status 404 returned error can't find the container with id 77b2d0bb1f607dd8077d2364c5aa4e4d1e18d281238b514c534c835698b05bb6 Jun 15 01:53:31.174236 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.174195 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-4wb5x"] Jun 15 01:53:31.176535 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:53:31.176506 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2b4b44_38bd_4370_9b0d_eda7e6a54a5d.slice/crio-9f863b0bc91774bb2a1724580edeae354f400abf47230594102032e6a949ea7d WatchSource:0}: Error finding container 9f863b0bc91774bb2a1724580edeae354f400abf47230594102032e6a949ea7d: Status 404 returned error can't find the container with id 9f863b0bc91774bb2a1724580edeae354f400abf47230594102032e6a949ea7d Jun 15 01:53:31.275404 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.275375 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7b64764fc8-hmgj7"] Jun 15 01:53:31.277820 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:53:31.277795 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a64029_2a54_4056_9b6f_d572dcbcc337.slice/crio-a2d0de197f138b9c9087f997e120b032a04d9c1e207c8bea3a0445805bb4ff0a WatchSource:0}: Error finding container a2d0de197f138b9c9087f997e120b032a04d9c1e207c8bea3a0445805bb4ff0a: Status 404 returned error can't find the container with id a2d0de197f138b9c9087f997e120b032a04d9c1e207c8bea3a0445805bb4ff0a Jun 15 01:53:31.933288 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.933186 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" event={"ID":"ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d","Type":"ContainerStarted","Data":"9f863b0bc91774bb2a1724580edeae354f400abf47230594102032e6a949ea7d"} Jun 15 01:53:31.935808 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.935736 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" event={"ID":"7c603aab-fc77-4813-9a96-aaa351963e47","Type":"ContainerStarted","Data":"77b2d0bb1f607dd8077d2364c5aa4e4d1e18d281238b514c534c835698b05bb6"} Jun 15 01:53:31.939563 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:31.939513 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b64764fc8-hmgj7" event={"ID":"84a64029-2a54-4056-9b6f-d572dcbcc337","Type":"ContainerStarted","Data":"a2d0de197f138b9c9087f997e120b032a04d9c1e207c8bea3a0445805bb4ff0a"} Jun 15 01:53:34.955118 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.955086 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" event={"ID":"ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d","Type":"ContainerStarted","Data":"c787b581b1823ac3e490ec60788e578bb6f541a8e25025205950367cea3bba91"} Jun 15 01:53:34.955532 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.955161 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" Jun 15 01:53:34.956607 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.956578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" event={"ID":"7c603aab-fc77-4813-9a96-aaa351963e47","Type":"ContainerStarted","Data":"1896d8089dde9e0fb87920265ef82b4611dbaad8eb9037961698661b7e7a7fc4"} Jun 15 01:53:34.956766 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.956678 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" Jun 15 01:53:34.957967 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.957937 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7b64764fc8-hmgj7" event={"ID":"84a64029-2a54-4056-9b6f-d572dcbcc337","Type":"ContainerStarted","Data":"6ea3c9716c851593c292b7a894f84968045d74b985f71bc319f74a4f7c448aba"} Jun 15 01:53:34.958086 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.958053 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:34.969536 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.969452 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" podStartSLOduration=2.194354091 podStartE2EDuration="4.969435868s" totalImagesPullingTime="2.775081777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:53:34.968914632 +0000 UTC m=+890.819845521" watchObservedRunningTime="2026-06-15 01:53:34.969435868 +0000 UTC m=+890.820366702" Jun 15 01:53:34.983452 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.983409 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" podStartSLOduration=2.177547447 podStartE2EDuration="4.983398205s" totalImagesPullingTime="2.805850758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:53:34.981846745 +0000 UTC m=+890.832777597" watchObservedRunningTime="2026-06-15 01:53:34.983398205 +0000 UTC m=+890.834329067" Jun 15 01:53:34.996760 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:34.996725 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-7b64764fc8-hmgj7" podStartSLOduration=2.37876083 podStartE2EDuration="4.996712694s" totalImagesPullingTime="2.617951864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:53:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:53:34.995106026 +0000 UTC m=+890.846036883" watchObservedRunningTime="2026-06-15 01:53:34.996712694 +0000 UTC m=+890.847643528" Jun 15 01:53:40.967820 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:40.967786 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-7b64764fc8-hmgj7" Jun 15 01:53:44.517709 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:44.517673 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:53:44.518568 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:44.518545 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:53:45.964752 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:45.964707 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-4wb5x" Jun 15 01:53:45.965174 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:53:45.964806 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-z8qkb" Jun 15 01:54:36.302719 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.302684 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r"] Jun 15 01:54:36.305254 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.305236 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.308208 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.308186 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 01:54:36.308328 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.308213 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 01:54:36.308854 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.308838 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 15 01:54:36.308923 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.308878 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2tdsw\"" Jun 15 01:54:36.316760 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.316735 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r"] Jun 15 01:54:36.402490 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.402460 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.402664 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.402515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.402664 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.402579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4rx\" (UniqueName: \"kubernetes.io/projected/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-kube-api-access-gj4rx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.402664 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.402621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.402664 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.402649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.402806 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.402670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.503528 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.503496 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.503704 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.503551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4rx\" (UniqueName: \"kubernetes.io/projected/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-kube-api-access-gj4rx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.503704 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.503585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.503704 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.503600 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.503704 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.503622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.503704 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.503681 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.504147 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.504118 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.504147 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.504134 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.504326 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.504307 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.505811 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.505780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.505961 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.505944 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.511722 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.511702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4rx\" (UniqueName: \"kubernetes.io/projected/87548db4-3fac-4d44-a4db-5fd5a2a5e0a7-kube-api-access-gj4rx\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r\" (UID: \"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.616679 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.616623 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:54:36.752418 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:36.752389 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r"] Jun 15 01:54:36.755156 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:54:36.755125 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87548db4_3fac_4d44_a4db_5fd5a2a5e0a7.slice/crio-030d4917bf2262438f21ce4956e66e0869c944632918af9d27f116f3d9931399 WatchSource:0}: Error finding container 030d4917bf2262438f21ce4956e66e0869c944632918af9d27f116f3d9931399: Status 404 returned error can't find the container with id 030d4917bf2262438f21ce4956e66e0869c944632918af9d27f116f3d9931399 Jun 15 01:54:37.258056 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:37.258023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" event={"ID":"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7","Type":"ContainerStarted","Data":"030d4917bf2262438f21ce4956e66e0869c944632918af9d27f116f3d9931399"} Jun 15 01:54:41.282074 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:41.282039 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" event={"ID":"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7","Type":"ContainerStarted","Data":"64fa94386b5d622e510e1bce1a75b7154e555ffcada7e01f549bd202e796d5e7"} Jun 15 01:54:56.978765 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:56.978736 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf"] Jun 15 01:54:56.982304 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:56.982280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:56.984409 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:56.984386 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 15 01:54:56.993801 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:56.993779 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf"] Jun 15 01:54:57.070819 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.070786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.070977 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.070826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d33d5fd1-81bc-4ca5-8231-b3850e985d46-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.070977 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.070844 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.070977 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.070948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.071148 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.071044 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjwq5\" (UniqueName: \"kubernetes.io/projected/d33d5fd1-81bc-4ca5-8231-b3850e985d46-kube-api-access-rjwq5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.071148 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.071099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.171482 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.171454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjwq5\" (UniqueName: \"kubernetes.io/projected/d33d5fd1-81bc-4ca5-8231-b3850e985d46-kube-api-access-rjwq5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.171667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.171499 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.171667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.171527 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.171667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.171543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d33d5fd1-81bc-4ca5-8231-b3850e985d46-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.171667 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.171561 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.171880 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.171737 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.171938 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.171921 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.171990 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.171975 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.172067 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.172048 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.173838 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.173819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d33d5fd1-81bc-4ca5-8231-b3850e985d46-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.174020 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.174003 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d33d5fd1-81bc-4ca5-8231-b3850e985d46-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.179619 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.179595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjwq5\" (UniqueName: \"kubernetes.io/projected/d33d5fd1-81bc-4ca5-8231-b3850e985d46-kube-api-access-rjwq5\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf\" (UID: \"d33d5fd1-81bc-4ca5-8231-b3850e985d46\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.294819 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.294763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:54:57.427447 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:57.427424 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf"] Jun 15 01:54:57.430568 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:54:57.430540 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd33d5fd1_81bc_4ca5_8231_b3850e985d46.slice/crio-d865946bf06407e4cd6da131525fdea1aa8523a7d2e33872a9ec818868299fa6 WatchSource:0}: Error finding container d865946bf06407e4cd6da131525fdea1aa8523a7d2e33872a9ec818868299fa6: Status 404 returned error can't find the container with id d865946bf06407e4cd6da131525fdea1aa8523a7d2e33872a9ec818868299fa6 Jun 15 01:54:58.367208 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:58.367175 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" event={"ID":"d33d5fd1-81bc-4ca5-8231-b3850e985d46","Type":"ContainerStarted","Data":"bc4707d67abacc5dffa1f0c92d53fc8604fc3ef9ad32d85efa576cf532b0f9fe"} Jun 15 01:54:58.367575 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:58.367232 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" event={"ID":"d33d5fd1-81bc-4ca5-8231-b3850e985d46","Type":"ContainerStarted","Data":"d865946bf06407e4cd6da131525fdea1aa8523a7d2e33872a9ec818868299fa6"} Jun 15 01:54:59.372961 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:59.372889 2574 generic.go:356] "Generic (PLEG): container finished" podID="d33d5fd1-81bc-4ca5-8231-b3850e985d46" containerID="bc4707d67abacc5dffa1f0c92d53fc8604fc3ef9ad32d85efa576cf532b0f9fe" exitCode=0 Jun 15 01:54:59.372961 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:54:59.372930 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" event={"ID":"d33d5fd1-81bc-4ca5-8231-b3850e985d46","Type":"ContainerDied","Data":"bc4707d67abacc5dffa1f0c92d53fc8604fc3ef9ad32d85efa576cf532b0f9fe"} Jun 15 01:55:01.383375 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:01.383335 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" event={"ID":"d33d5fd1-81bc-4ca5-8231-b3850e985d46","Type":"ContainerStarted","Data":"ae55b5b0bdbbad668b8d4a69d55269c3e618b120bd3d543c0f4f3421450dbd02"} Jun 15 01:55:01.402837 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:01.402790 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" podStartSLOduration=3.118769767 podStartE2EDuration="5.40277381s" totalImagesPullingTime="1.023573127s" totalInitContainerRuntime="1.260430916s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:54:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:55:01.400718932 +0000 UTC m=+977.251649783" watchObservedRunningTime="2026-06-15 01:55:01.40277381 +0000 UTC m=+977.253704690" Jun 15 01:55:02.884135 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:02.884092 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm"] Jun 15 01:55:02.887771 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:02.887747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:02.889747 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:02.889720 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 15 01:55:02.901140 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:02.901118 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm"] Jun 15 01:55:03.019185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.019154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzdnv\" (UniqueName: \"kubernetes.io/projected/ddae47f4-c19e-4e61-9722-c80edc459ac6-kube-api-access-xzdnv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.019185 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.019188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.019349 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.019207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.019349 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.019232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.019349 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.019249 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.019349 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.019265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddae47f4-c19e-4e61-9722-c80edc459ac6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.119676 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.119622 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdnv\" (UniqueName: \"kubernetes.io/projected/ddae47f4-c19e-4e61-9722-c80edc459ac6-kube-api-access-xzdnv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.119822 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.119683 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.119822 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.119718 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.119822 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.119759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.119822 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.119783 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.119822 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.119807 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddae47f4-c19e-4e61-9722-c80edc459ac6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.120158 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.120132 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.120223 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.120160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.120223 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.120188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.122103 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.122081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ddae47f4-c19e-4e61-9722-c80edc459ac6-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.122380 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.122357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ddae47f4-c19e-4e61-9722-c80edc459ac6-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.127908 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.127884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdnv\" (UniqueName: \"kubernetes.io/projected/ddae47f4-c19e-4e61-9722-c80edc459ac6-kube-api-access-xzdnv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm\" (UID: \"ddae47f4-c19e-4e61-9722-c80edc459ac6\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.198306 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.198254 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:55:03.325934 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.325903 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm"] Jun 15 01:55:03.327739 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:55:03.327713 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddae47f4_c19e_4e61_9722_c80edc459ac6.slice/crio-e4f4655114682b5fd0cb26cfdabf7bf362f652edf2ad4ff413165f18abc26c8e WatchSource:0}: Error finding container e4f4655114682b5fd0cb26cfdabf7bf362f652edf2ad4ff413165f18abc26c8e: Status 404 returned error can't find the container with id e4f4655114682b5fd0cb26cfdabf7bf362f652edf2ad4ff413165f18abc26c8e Jun 15 01:55:03.394614 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.394578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" event={"ID":"ddae47f4-c19e-4e61-9722-c80edc459ac6","Type":"ContainerStarted","Data":"d9c0ef3ab97373b1173b63ef5bc15d554616aa1a9be30a2313685e5f5d5c0b57"} Jun 15 01:55:03.394735 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:03.394677 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" event={"ID":"ddae47f4-c19e-4e61-9722-c80edc459ac6","Type":"ContainerStarted","Data":"e4f4655114682b5fd0cb26cfdabf7bf362f652edf2ad4ff413165f18abc26c8e"} Jun 15 01:55:07.295834 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:07.295798 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:55:07.296311 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:07.295858 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:55:07.308454 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:07.308432 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:55:07.426413 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:07.426378 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf" Jun 15 01:55:55.642548 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:55.642515 2574 generic.go:356] "Generic (PLEG): container finished" podID="87548db4-3fac-4d44-a4db-5fd5a2a5e0a7" containerID="64fa94386b5d622e510e1bce1a75b7154e555ffcada7e01f549bd202e796d5e7" exitCode=0 Jun 15 01:55:55.642945 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:55.642594 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" event={"ID":"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7","Type":"ContainerDied","Data":"64fa94386b5d622e510e1bce1a75b7154e555ffcada7e01f549bd202e796d5e7"} Jun 15 01:55:56.649559 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:56.649523 2574 generic.go:356] "Generic (PLEG): container finished" podID="ddae47f4-c19e-4e61-9722-c80edc459ac6" containerID="d9c0ef3ab97373b1173b63ef5bc15d554616aa1a9be30a2313685e5f5d5c0b57" exitCode=0 Jun 15 01:55:56.650008 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:56.649595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" event={"ID":"ddae47f4-c19e-4e61-9722-c80edc459ac6","Type":"ContainerDied","Data":"d9c0ef3ab97373b1173b63ef5bc15d554616aa1a9be30a2313685e5f5d5c0b57"} Jun 15 01:55:56.651537 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:56.651512 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" event={"ID":"87548db4-3fac-4d44-a4db-5fd5a2a5e0a7","Type":"ContainerStarted","Data":"94a4487ed05296e7c23eb121471942da95bfc52317b3e2c9ffbc626550930eba"} Jun 15 01:55:56.683617 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:56.683566 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" podStartSLOduration=1.756791931 podStartE2EDuration="1m20.683552107s" totalImagesPullingTime="3.822182414s" totalInitContainerRuntime="1m15.104577762s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:54:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:55:56.681956429 +0000 UTC m=+1032.532887264" watchObservedRunningTime="2026-06-15 01:55:56.683552107 +0000 UTC m=+1032.534482940" Jun 15 01:55:57.657836 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:57.657802 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" event={"ID":"ddae47f4-c19e-4e61-9722-c80edc459ac6","Type":"ContainerStarted","Data":"23fb11d4881d78816452ec87e00e3ec5172a6c944cf1f08401f42f9920b78dda"} Jun 15 01:55:57.675999 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:55:57.675940 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" podStartSLOduration=2.91783489 podStartE2EDuration="55.675911612s" totalImagesPullingTime="184.656706ms" totalInitContainerRuntime="52.573420016s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:55:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:55:57.675171355 +0000 UTC m=+1033.526102204" watchObservedRunningTime="2026-06-15 01:55:57.675911612 +0000 UTC m=+1033.526842446" Jun 15 01:56:03.199164 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:56:03.199120 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:56:03.199626 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:56:03.199189 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:56:03.211700 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:56:03.211671 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:56:03.698431 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:56:03.698406 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm" Jun 15 01:56:06.617040 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:56:06.617006 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:56:06.617427 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:56:06.617312 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:56:06.629569 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:56:06.629546 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:56:06.713873 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:56:06.713846 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r" Jun 15 01:57:33.099008 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.098977 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bfb858b88-h59qw"] Jun 15 01:57:33.099549 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.099174 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5bfb858b88-h59qw" podUID="204f411a-dd52-4717-b530-8907f0ff4d82" containerName="manager" containerID="cri-o://907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5" gracePeriod=30 Jun 15 01:57:33.338726 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.338698 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:57:33.359027 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.358961 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9d69\" (UniqueName: \"kubernetes.io/projected/204f411a-dd52-4717-b530-8907f0ff4d82-kube-api-access-r9d69\") pod \"204f411a-dd52-4717-b530-8907f0ff4d82\" (UID: \"204f411a-dd52-4717-b530-8907f0ff4d82\") " Jun 15 01:57:33.359027 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.358996 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/204f411a-dd52-4717-b530-8907f0ff4d82-webhook-cert\") pod \"204f411a-dd52-4717-b530-8907f0ff4d82\" (UID: \"204f411a-dd52-4717-b530-8907f0ff4d82\") " Jun 15 01:57:33.361410 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.361375 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/204f411a-dd52-4717-b530-8907f0ff4d82-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "204f411a-dd52-4717-b530-8907f0ff4d82" (UID: "204f411a-dd52-4717-b530-8907f0ff4d82"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:57:33.361538 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.361378 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/204f411a-dd52-4717-b530-8907f0ff4d82-kube-api-access-r9d69" (OuterVolumeSpecName: "kube-api-access-r9d69") pod "204f411a-dd52-4717-b530-8907f0ff4d82" (UID: "204f411a-dd52-4717-b530-8907f0ff4d82"). InnerVolumeSpecName "kube-api-access-r9d69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:57:33.460023 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.459995 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9d69\" (UniqueName: \"kubernetes.io/projected/204f411a-dd52-4717-b530-8907f0ff4d82-kube-api-access-r9d69\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:57:33.460023 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:33.460020 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/204f411a-dd52-4717-b530-8907f0ff4d82-webhook-cert\") on node \"ip-10-0-135-94.ec2.internal\" DevicePath \"\"" Jun 15 01:57:34.129900 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.129863 2574 generic.go:356] "Generic (PLEG): container finished" podID="204f411a-dd52-4717-b530-8907f0ff4d82" containerID="907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5" exitCode=0 Jun 15 01:57:34.130362 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.129905 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb858b88-h59qw" Jun 15 01:57:34.130362 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.129947 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb858b88-h59qw" event={"ID":"204f411a-dd52-4717-b530-8907f0ff4d82","Type":"ContainerDied","Data":"907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5"} Jun 15 01:57:34.130362 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.129997 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb858b88-h59qw" event={"ID":"204f411a-dd52-4717-b530-8907f0ff4d82","Type":"ContainerDied","Data":"d6b9ee9d81d2ab2d236b689946486b008e0f9f6bb51aad2758cc5835f5d5c17c"} Jun 15 01:57:34.130362 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.130020 2574 scope.go:117] "RemoveContainer" containerID="907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5" Jun 15 01:57:34.139144 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.139129 2574 scope.go:117] "RemoveContainer" containerID="907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5" Jun 15 01:57:34.139393 ip-10-0-135-94 kubenswrapper[2574]: E0615 01:57:34.139379 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5\": container with ID starting with 907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5 not found: ID does not exist" containerID="907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5" Jun 15 01:57:34.139436 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.139400 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5"} err="failed to get container status \"907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5\": rpc error: code = NotFound desc = could not find container \"907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5\": container with ID starting with 907ecd9e5d976ecffae02764014c05abbe4d1f6ba364c6498be806fff96841e5 not found: ID does not exist" Jun 15 01:57:34.149869 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.149848 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5bfb858b88-h59qw"] Jun 15 01:57:34.156061 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.156041 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5bfb858b88-h59qw"] Jun 15 01:57:34.510297 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.510225 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204f411a-dd52-4717-b530-8907f0ff4d82" path="/var/lib/kubelet/pods/204f411a-dd52-4717-b530-8907f0ff4d82/volumes" Jun 15 01:57:34.931491 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.931459 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5bfb858b88-mpw76"] Jun 15 01:57:34.931854 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.931841 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204f411a-dd52-4717-b530-8907f0ff4d82" containerName="manager" Jun 15 01:57:34.931910 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.931856 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="204f411a-dd52-4717-b530-8907f0ff4d82" containerName="manager" Jun 15 01:57:34.931942 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.931913 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="204f411a-dd52-4717-b530-8907f0ff4d82" containerName="manager" Jun 15 01:57:34.934952 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.934933 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:34.937380 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.937363 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 01:57:34.937456 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.937422 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 01:57:34.937517 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.937479 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-f2lks\"" Jun 15 01:57:34.941715 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.941693 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bfb858b88-mpw76"] Jun 15 01:57:34.972722 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.972684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8nz6\" (UniqueName: \"kubernetes.io/projected/036ff933-7015-40d7-86fd-d1d5335eb09c-kube-api-access-q8nz6\") pod \"maas-controller-5bfb858b88-mpw76\" (UID: \"036ff933-7015-40d7-86fd-d1d5335eb09c\") " pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:34.972828 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:34.972811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/036ff933-7015-40d7-86fd-d1d5335eb09c-webhook-cert\") pod \"maas-controller-5bfb858b88-mpw76\" (UID: \"036ff933-7015-40d7-86fd-d1d5335eb09c\") " pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:35.073517 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:35.073490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/036ff933-7015-40d7-86fd-d1d5335eb09c-webhook-cert\") pod \"maas-controller-5bfb858b88-mpw76\" (UID: \"036ff933-7015-40d7-86fd-d1d5335eb09c\") " pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:35.073701 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:35.073558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8nz6\" (UniqueName: \"kubernetes.io/projected/036ff933-7015-40d7-86fd-d1d5335eb09c-kube-api-access-q8nz6\") pod \"maas-controller-5bfb858b88-mpw76\" (UID: \"036ff933-7015-40d7-86fd-d1d5335eb09c\") " pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:35.075912 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:35.075891 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/036ff933-7015-40d7-86fd-d1d5335eb09c-webhook-cert\") pod \"maas-controller-5bfb858b88-mpw76\" (UID: \"036ff933-7015-40d7-86fd-d1d5335eb09c\") " pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:35.082461 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:35.082436 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8nz6\" (UniqueName: \"kubernetes.io/projected/036ff933-7015-40d7-86fd-d1d5335eb09c-kube-api-access-q8nz6\") pod \"maas-controller-5bfb858b88-mpw76\" (UID: \"036ff933-7015-40d7-86fd-d1d5335eb09c\") " pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:35.246622 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:35.246557 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:35.374342 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:35.374221 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5bfb858b88-mpw76"] Jun 15 01:57:35.376579 ip-10-0-135-94 kubenswrapper[2574]: W0615 01:57:35.376555 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod036ff933_7015_40d7_86fd_d1d5335eb09c.slice/crio-232bc51f703baf94f0813ef95f41da971fe02d9d5a5b3965ceaea06e78fb174a WatchSource:0}: Error finding container 232bc51f703baf94f0813ef95f41da971fe02d9d5a5b3965ceaea06e78fb174a: Status 404 returned error can't find the container with id 232bc51f703baf94f0813ef95f41da971fe02d9d5a5b3965ceaea06e78fb174a Jun 15 01:57:36.142193 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:36.142158 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb858b88-mpw76" event={"ID":"036ff933-7015-40d7-86fd-d1d5335eb09c","Type":"ContainerStarted","Data":"d7c4e04f611ed3db68f4afe17c0deea604f660ebe52efb895d1f0be9ddf64582"} Jun 15 01:57:36.142360 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:36.142208 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5bfb858b88-mpw76" event={"ID":"036ff933-7015-40d7-86fd-d1d5335eb09c","Type":"ContainerStarted","Data":"232bc51f703baf94f0813ef95f41da971fe02d9d5a5b3965ceaea06e78fb174a"} Jun 15 01:57:36.142360 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:36.142291 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:57:36.156964 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:36.156913 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5bfb858b88-mpw76" podStartSLOduration=1.758569337 podStartE2EDuration="2.156894831s" totalImagesPullingTime="398.325494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:57:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:57:36.156358031 +0000 UTC m=+1132.007288866" watchObservedRunningTime="2026-06-15 01:57:36.156894831 +0000 UTC m=+1132.007825666" Jun 15 01:57:47.152507 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:57:47.152478 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5bfb858b88-mpw76" Jun 15 01:58:44.545425 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:58:44.545398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 01:58:44.547181 ip-10-0-135-94 kubenswrapper[2574]: I0615 01:58:44.547160 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:03:44.576631 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:03:44.576597 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:03:44.579907 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:03:44.579883 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:08:44.605421 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:08:44.605397 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:08:44.608463 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:08:44.608440 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:13:44.633831 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:13:44.633806 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:13:44.637175 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:13:44.637154 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:18:30.310073 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:30.310041 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-845d6f7cf8-46cch_e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e/nginx/0.log" Jun 15 02:18:30.523664 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:30.523626 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lw7xn_0039cb41-569f-49b6-b972-32dffa5e1cd0/manager/0.log" Jun 15 02:18:30.642798 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:30.642769 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-m8dl6_e4be65e0-70f1-4b12-afdc-37b373779651/manager/0.log" Jun 15 02:18:30.764574 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:30.764548 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b64764fc8-hmgj7_84a64029-2a54-4056-9b6f-d572dcbcc337/maas-api/0.log" Jun 15 02:18:30.997073 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:30.996999 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5bfb858b88-mpw76_036ff933-7015-40d7-86fd-d1d5335eb09c/manager/0.log" Jun 15 02:18:31.107468 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:31.107440 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-ds2sx_d74e5b29-ba43-4255-b1cc-bab27b09dc6a/server/0.log" Jun 15 02:18:31.228315 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:31.228291 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-l9cfr_da391598-c62e-433a-a327-e91d5fddd760/manager/0.log" Jun 15 02:18:31.577084 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:31.577057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-xfb5z_843f1272-ea09-4044-ae70-4114c2abcff3/copy-manifests/0.log" Jun 15 02:18:31.594562 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:31.594539 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-xfb5z_843f1272-ea09-4044-ae70-4114c2abcff3/manager/0.log" Jun 15 02:18:31.708113 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:31.708087 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-srtp9_b07ba3c8-1c01-4388-acd0-7723d494db7d/postgres/0.log" Jun 15 02:18:33.763437 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:33.763409 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f64k5_7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00/manager/0.log" Jun 15 02:18:34.217765 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:34.217736 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-75wh4_af1206a6-8186-498b-b2a8-797993bbe1e5/discovery/0.log" Jun 15 02:18:34.435882 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:34.435860 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-rc29d_5864cd5c-f66b-48e2-afba-a762badfa76c/kube-auth-proxy/0.log" Jun 15 02:18:34.682249 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:34.682213 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-z8qkb_7c603aab-fc77-4813-9a96-aaa351963e47/payload-pre-processing/0.log" Jun 15 02:18:34.799183 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:34.799161 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4wb5x_ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d/payload-processing/0.log" Jun 15 02:18:35.254787 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:35.254757 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r_87548db4-3fac-4d44-a4db-5fd5a2a5e0a7/storage-initializer/0.log" Jun 15 02:18:35.262331 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:35.262296 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-npn4r_87548db4-3fac-4d44-a4db-5fd5a2a5e0a7/main/0.log" Jun 15 02:18:35.492746 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:35.492717 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf_d33d5fd1-81bc-4ca5-8231-b3850e985d46/main/0.log" Jun 15 02:18:35.500597 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:35.500576 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-cv7rf_d33d5fd1-81bc-4ca5-8231-b3850e985d46/storage-initializer/0.log" Jun 15 02:18:35.608370 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:35.608346 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm_ddae47f4-c19e-4e61-9722-c80edc459ac6/storage-initializer/0.log" Jun 15 02:18:35.616289 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:35.616270 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxkmkm_ddae47f4-c19e-4e61-9722-c80edc459ac6/main/0.log" Jun 15 02:18:42.757546 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:42.757509 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-22rjz_9d10b3c3-904f-4cc5-b6c8-ccfb50e8cbc3/global-pull-secret-syncer/0.log" Jun 15 02:18:42.961244 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:42.961216 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zgndx_92dabc05-371d-4409-9ed1-945647845c72/konnectivity-agent/0.log" Jun 15 02:18:43.007054 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:43.007028 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-94.ec2.internal_406f3ba4471af0eee5340b4f98906d46/haproxy/0.log" Jun 15 02:18:44.660579 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:44.660551 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:18:44.665606 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:44.665583 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4pcf7_25e574c2-6beb-402c-b25c-1dc459ffbad5/ovn-acl-logging/0.log" Jun 15 02:18:46.711742 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:46.711709 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-4rms5_1bb2a933-ebda-4f0d-98a2-a1de825c528b/sail-operator/0.log" Jun 15 02:18:47.984238 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:47.984208 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f64k5_7b95ec8f-f9cd-40e3-ab33-6d391dc9cf00/manager/0.log" Jun 15 02:18:50.206376 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:50.206347 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6qx6_109dda05-f0cf-499a-9625-14ea38804475/node-exporter/0.log" Jun 15 02:18:50.228297 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:50.228269 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6qx6_109dda05-f0cf-499a-9625-14ea38804475/kube-rbac-proxy/0.log" Jun 15 02:18:50.248742 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:50.248717 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m6qx6_109dda05-f0cf-499a-9625-14ea38804475/init-textfile/0.log" Jun 15 02:18:53.659909 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:53.659880 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f6649dcb9-lsgpn_153a3afd-2ff6-48ff-ba95-df017b6bc9b0/console/0.log" Jun 15 02:18:54.839582 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.839553 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r"] Jun 15 02:18:54.843110 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.843090 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:54.845061 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.845024 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2jt7g\"/\"openshift-service-ca.crt\"" Jun 15 02:18:54.845212 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.845089 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2jt7g\"/\"kube-root-ca.crt\"" Jun 15 02:18:54.845534 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.845519 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2jt7g\"/\"default-dockercfg-kldtp\"" Jun 15 02:18:54.852225 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.852205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r"] Jun 15 02:18:54.976772 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.976747 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-sys\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:54.976886 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.976776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-proc\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:54.976886 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.976792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-lib-modules\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:54.976886 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.976815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-podres\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:54.976994 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:54.976902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7hpc\" (UniqueName: \"kubernetes.io/projected/b7544e0f-4a35-4ff2-895b-5683de305614-kube-api-access-w7hpc\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077295 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-sys\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077295 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077303 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-proc\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077512 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077322 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-lib-modules\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077512 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-podres\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077512 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077381 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-sys\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077512 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077394 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-proc\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077512 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7hpc\" (UniqueName: \"kubernetes.io/projected/b7544e0f-4a35-4ff2-895b-5683de305614-kube-api-access-w7hpc\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077512 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-lib-modules\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.077512 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.077485 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b7544e0f-4a35-4ff2-895b-5683de305614-podres\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.084799 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.084776 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7hpc\" (UniqueName: \"kubernetes.io/projected/b7544e0f-4a35-4ff2-895b-5683de305614-kube-api-access-w7hpc\") pod \"perf-node-gather-daemonset-f7p6r\" (UID: \"b7544e0f-4a35-4ff2-895b-5683de305614\") " pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.154060 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.154003 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:55.279215 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.279192 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r"] Jun 15 02:18:55.281683 ip-10-0-135-94 kubenswrapper[2574]: W0615 02:18:55.281623 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb7544e0f_4a35_4ff2_895b_5683de305614.slice/crio-0e43ae1cf10219189f65e37a5a5b9c90a6a07603fc566200c342f09983082321 WatchSource:0}: Error finding container 0e43ae1cf10219189f65e37a5a5b9c90a6a07603fc566200c342f09983082321: Status 404 returned error can't find the container with id 0e43ae1cf10219189f65e37a5a5b9c90a6a07603fc566200c342f09983082321 Jun 15 02:18:55.336933 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.336907 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" event={"ID":"b7544e0f-4a35-4ff2-895b-5683de305614","Type":"ContainerStarted","Data":"0e43ae1cf10219189f65e37a5a5b9c90a6a07603fc566200c342f09983082321"} Jun 15 02:18:55.656263 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.656236 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-krlqp_4ba0ff22-7715-4be4-98f0-dd8e2af4625a/dns/0.log" Jun 15 02:18:55.677266 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.677246 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-krlqp_4ba0ff22-7715-4be4-98f0-dd8e2af4625a/kube-rbac-proxy/0.log" Jun 15 02:18:55.798963 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:55.798944 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t8rgh_7f2a2af3-7443-492d-a735-04f9c1e8961b/dns-node-resolver/0.log" Jun 15 02:18:56.344564 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:56.344532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" event={"ID":"b7544e0f-4a35-4ff2-895b-5683de305614","Type":"ContainerStarted","Data":"d78fe9beaf0420f6915e9b5edb0403e8a24d66de3024806339ca9312139f93ca"} Jun 15 02:18:56.344961 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:56.344596 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:18:56.361188 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:56.361141 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" podStartSLOduration=2.3611265169999998 podStartE2EDuration="2.361126517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:18:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:18:56.360332306 +0000 UTC m=+2412.211263145" watchObservedRunningTime="2026-06-15 02:18:56.361126517 +0000 UTC m=+2412.212057396" Jun 15 02:18:56.396174 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:56.396141 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-779989c8df-wt6zj_05945e40-eea9-4bba-838c-3f19150f0f77/registry/0.log" Jun 15 02:18:56.411980 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:56.411956 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-779989c8df-wt6zj_05945e40-eea9-4bba-838c-3f19150f0f77/registry/1.log" Jun 15 02:18:56.442622 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:56.442595 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w5pfh_758f4a15-f524-48f4-a92e-555379652796/node-ca/0.log" Jun 15 02:18:57.522060 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:57.522023 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-75wh4_af1206a6-8186-498b-b2a8-797993bbe1e5/discovery/0.log" Jun 15 02:18:57.574456 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:57.574423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-rc29d_5864cd5c-f66b-48e2-afba-a762badfa76c/kube-auth-proxy/0.log" Jun 15 02:18:57.718612 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:57.718584 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-z8qkb_7c603aab-fc77-4813-9a96-aaa351963e47/payload-pre-processing/0.log" Jun 15 02:18:57.818406 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:57.818322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4wb5x_ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d/payload-processing/0.log" Jun 15 02:18:58.519369 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:58.519334 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-p66kz_8cbacee2-636d-4e29-a8fe-f6470080f24c/serve-healthcheck-canary/0.log" Jun 15 02:18:59.161287 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:59.161253 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh86z_17b13c4f-f941-4c65-a6c9-a4dca2937d2f/kube-rbac-proxy/0.log" Jun 15 02:18:59.181447 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:59.181424 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh86z_17b13c4f-f941-4c65-a6c9-a4dca2937d2f/exporter/0.log" Jun 15 02:18:59.202783 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:18:59.202758 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lh86z_17b13c4f-f941-4c65-a6c9-a4dca2937d2f/extractor/0.log" Jun 15 02:19:01.424548 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:01.424514 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-845d6f7cf8-46cch_e4fa8ba6-ccd8-42bd-a83f-50aefe83e59e/nginx/0.log" Jun 15 02:19:01.477493 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:01.477449 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-lw7xn_0039cb41-569f-49b6-b972-32dffa5e1cd0/manager/0.log" Jun 15 02:19:01.603081 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:01.603042 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-m8dl6_e4be65e0-70f1-4b12-afdc-37b373779651/manager/0.log" Jun 15 02:19:01.653866 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:01.653840 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7b64764fc8-hmgj7_84a64029-2a54-4056-9b6f-d572dcbcc337/maas-api/0.log" Jun 15 02:19:01.775031 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:01.774958 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5bfb858b88-mpw76_036ff933-7015-40d7-86fd-d1d5335eb09c/manager/0.log" Jun 15 02:19:01.804571 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:01.804549 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-ds2sx_d74e5b29-ba43-4255-b1cc-bab27b09dc6a/server/0.log" Jun 15 02:19:01.875800 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:01.875773 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-l9cfr_da391598-c62e-433a-a327-e91d5fddd760/manager/0.log" Jun 15 02:19:02.119394 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:02.119365 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-xfb5z_843f1272-ea09-4044-ae70-4114c2abcff3/manager/0.log" Jun 15 02:19:02.135711 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:02.135692 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d6d6cd49-xfb5z_843f1272-ea09-4044-ae70-4114c2abcff3/copy-manifests/0.log" Jun 15 02:19:02.159776 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:02.159744 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-srtp9_b07ba3c8-1c01-4388-acd0-7723d494db7d/postgres/0.log" Jun 15 02:19:02.359237 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:02.359213 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2jt7g/perf-node-gather-daemonset-f7p6r" Jun 15 02:19:03.803692 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:03.803633 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-rkgrm_5277361a-0c3a-42a2-9091-e6952a2a39eb/openshift-lws-operator/0.log" Jun 15 02:19:07.989507 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:07.989470 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-75wh4_af1206a6-8186-498b-b2a8-797993bbe1e5/discovery/0.log" Jun 15 02:19:08.017216 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:08.017191 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-rc29d_5864cd5c-f66b-48e2-afba-a762badfa76c/kube-auth-proxy/0.log" Jun 15 02:19:08.137649 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:08.137608 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-z8qkb_7c603aab-fc77-4813-9a96-aaa351963e47/payload-pre-processing/0.log" Jun 15 02:19:08.224838 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:08.224815 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4wb5x_ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d/payload-processing/0.log" Jun 15 02:19:09.506743 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:09.506711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-75wh4_af1206a6-8186-498b-b2a8-797993bbe1e5/discovery/0.log" Jun 15 02:19:09.537280 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:09.537256 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-rc29d_5864cd5c-f66b-48e2-afba-a762badfa76c/kube-auth-proxy/0.log" Jun 15 02:19:09.648811 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:09.648782 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-z8qkb_7c603aab-fc77-4813-9a96-aaa351963e47/payload-pre-processing/0.log" Jun 15 02:19:09.742227 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:09.742195 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4wb5x_ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d/payload-processing/0.log" Jun 15 02:19:11.103330 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.103306 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bndl9_4d20763a-906f-4ae3-ab71-457ec9b2a1b2/kube-multus-additional-cni-plugins/0.log" Jun 15 02:19:11.125739 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.125716 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bndl9_4d20763a-906f-4ae3-ab71-457ec9b2a1b2/egress-router-binary-copy/0.log" Jun 15 02:19:11.152083 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.152053 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bndl9_4d20763a-906f-4ae3-ab71-457ec9b2a1b2/cni-plugins/0.log" Jun 15 02:19:11.176082 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.176061 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bndl9_4d20763a-906f-4ae3-ab71-457ec9b2a1b2/bond-cni-plugin/0.log" Jun 15 02:19:11.201750 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.201726 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bndl9_4d20763a-906f-4ae3-ab71-457ec9b2a1b2/routeoverride-cni/0.log" Jun 15 02:19:11.222570 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.222549 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bndl9_4d20763a-906f-4ae3-ab71-457ec9b2a1b2/whereabouts-cni-bincopy/0.log" Jun 15 02:19:11.243391 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.243368 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bndl9_4d20763a-906f-4ae3-ab71-457ec9b2a1b2/whereabouts-cni/0.log" Jun 15 02:19:11.463694 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.463600 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j6jqq_7d25f315-6493-497b-b5b5-0e615401d7ee/kube-multus/0.log" Jun 15 02:19:11.511197 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.511175 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-75wh4_af1206a6-8186-498b-b2a8-797993bbe1e5/discovery/0.log" Jun 15 02:19:11.536513 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.536487 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-9566dff59-rc29d_5864cd5c-f66b-48e2-afba-a762badfa76c/kube-auth-proxy/0.log" Jun 15 02:19:11.639912 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.639888 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ddm5s_01c71114-88ea-43c9-9b1e-5993cac19357/network-metrics-daemon/0.log" Jun 15 02:19:11.662617 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.662598 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ddm5s_01c71114-88ea-43c9-9b1e-5993cac19357/kube-rbac-proxy/0.log" Jun 15 02:19:11.663972 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.663947 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-z8qkb_7c603aab-fc77-4813-9a96-aaa351963e47/payload-pre-processing/0.log" Jun 15 02:19:11.757159 ip-10-0-135-94 kubenswrapper[2574]: I0615 02:19:11.757091 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-4wb5x_ed2b4b44-38bd-4370-9b0d-eda7e6a54a5d/payload-processing/0.log"