Jun 03 00:19:33.773482 ip-10-0-129-183 systemd[1]: Starting Kubernetes Kubelet... Jun 03 00:19:34.336932 ip-10-0-129-183 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:19:34.336932 ip-10-0-129-183 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 00:19:34.336932 ip-10-0-129-183 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:19:34.336932 ip-10-0-129-183 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 00:19:34.336932 ip-10-0-129-183 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 00:19:34.339292 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.339133 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 00:19:34.342868 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342851 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:34.342868 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342868 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342871 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342874 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342877 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342879 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342882 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342885 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342888 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342890 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342893 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342895 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342898 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342900 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342903 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342911 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342914 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342917 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342919 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342922 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342925 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:34.342936 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342927 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342930 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342932 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342935 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342937 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342940 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342943 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342946 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342949 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342952 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342955 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342957 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342960 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342963 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342965 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342967 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342970 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342972 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342975 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342977 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:34.343442 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342980 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342984 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342988 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342991 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342993 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342996 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.342998 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343001 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343004 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343006 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343009 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343011 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343013 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343017 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343020 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343022 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343025 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343028 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343032 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:34.344133 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343034 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343037 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343039 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343041 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343044 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343047 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343050 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343054 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343057 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343060 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343063 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343066 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343069 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343072 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343075 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343078 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343081 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343083 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343086 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:34.344697 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343089 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:34.345155 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343092 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:34.345155 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343096 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:34.345155 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343099 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:34.345155 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343102 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:34.345155 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343105 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:34.345155 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.343108 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:34.347743 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347723 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:34.347743 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347741 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:34.347743 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347744 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:34.347743 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347747 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347751 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347755 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347758 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347761 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347764 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347767 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347771 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347773 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347776 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347779 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347782 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347785 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347787 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347789 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347794 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347798 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347801 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347804 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:34.347894 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347806 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347814 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347817 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347820 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347822 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347825 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347828 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347830 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347833 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347836 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347838 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347841 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347844 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347846 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347849 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347852 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347854 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347857 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347859 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347862 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:34.348368 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347865 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347867 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347870 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347873 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347876 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347878 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347880 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347883 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347885 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347888 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347891 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347896 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347900 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347903 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347906 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347909 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347912 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347914 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347917 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:34.348910 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347920 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347923 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347926 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347929 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347931 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347934 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347936 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347939 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347942 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347945 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347947 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347950 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347953 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347957 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347960 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347962 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347965 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347969 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347971 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347974 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:34.349430 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347976 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347979 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347981 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347984 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.347986 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348064 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348078 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348088 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348098 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348104 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348107 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348111 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348133 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348138 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348141 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348145 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348149 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348152 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348155 2574 flags.go:64] FLAG: --cgroup-root="" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348158 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348162 2574 flags.go:64] FLAG: --client-ca-file="" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348165 2574 flags.go:64] FLAG: --cloud-config="" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348167 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348170 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 00:19:34.349913 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348175 2574 flags.go:64] FLAG: --cluster-domain="" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348178 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348181 2574 flags.go:64] FLAG: --config-dir="" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348184 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348187 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348204 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348208 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348212 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348215 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348218 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348221 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348224 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348227 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348230 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348235 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348238 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348241 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348244 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348247 2574 flags.go:64] FLAG: --enable-server="true" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348250 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348256 2574 flags.go:64] FLAG: --event-burst="100" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348260 2574 flags.go:64] FLAG: --event-qps="50" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348263 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348266 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348269 2574 flags.go:64] FLAG: --eviction-hard="" Jun 03 00:19:34.350535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348273 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348276 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348278 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348282 2574 flags.go:64] FLAG: --eviction-soft="" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348285 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348288 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348291 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348294 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348297 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348300 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348303 2574 flags.go:64] FLAG: --feature-gates="" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348307 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348309 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348313 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348316 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348319 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348322 2574 flags.go:64] FLAG: --help="false" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348325 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348328 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348331 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348334 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348337 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348341 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348344 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 00:19:34.351130 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348347 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348350 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348353 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348356 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348359 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348362 2574 flags.go:64] FLAG: --kube-reserved="" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348365 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348368 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348372 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348375 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348378 2574 flags.go:64] FLAG: --lock-file="" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348381 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348384 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348388 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348393 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348396 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348399 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348402 2574 flags.go:64] FLAG: --logging-format="text" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348405 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348409 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348411 2574 flags.go:64] FLAG: --manifest-url="" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348414 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348419 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348423 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348427 2574 flags.go:64] FLAG: --max-pods="110" Jun 03 00:19:34.351727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348431 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348434 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348437 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348440 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348444 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348447 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348450 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348458 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348461 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348464 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348468 2574 flags.go:64] FLAG: --pod-cidr="" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348471 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348477 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348480 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348483 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348486 2574 flags.go:64] FLAG: --port="10250" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348490 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348493 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b746c2e6da954ee6" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348496 2574 flags.go:64] FLAG: --qos-reserved="" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348499 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348502 2574 flags.go:64] FLAG: --register-node="true" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348505 2574 flags.go:64] FLAG: --register-schedulable="true" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348508 2574 flags.go:64] FLAG: --register-with-taints="" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348512 2574 flags.go:64] FLAG: --registry-burst="10" Jun 03 00:19:34.352368 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348515 2574 flags.go:64] FLAG: --registry-qps="5" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348518 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348521 2574 flags.go:64] FLAG: --reserved-memory="" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348525 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348529 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348532 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348535 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348538 2574 flags.go:64] FLAG: --runonce="false" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348541 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348545 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348548 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348551 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348553 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348557 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348560 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348563 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348566 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348569 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348572 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348575 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348578 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348581 2574 flags.go:64] FLAG: --system-cgroups="" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348584 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348591 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348594 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 03 00:19:34.352948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348596 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348601 2574 flags.go:64] FLAG: --tls-min-version="" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348604 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348607 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348610 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348614 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348617 2574 flags.go:64] FLAG: --v="2" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348621 2574 flags.go:64] FLAG: --version="false" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348625 2574 flags.go:64] FLAG: --vmodule="" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348630 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348633 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348724 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348728 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348731 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348734 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348738 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348740 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348743 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348754 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348758 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348761 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348764 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:34.353560 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348767 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348770 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348773 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348776 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348779 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348781 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348785 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348788 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348790 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348793 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348796 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348802 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348804 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348807 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348810 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348812 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348815 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348818 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348820 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348823 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:34.354086 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348826 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348828 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348831 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348833 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348836 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348839 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348842 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348845 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348848 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348850 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348852 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348857 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348860 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348863 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348867 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348869 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348872 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348875 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348878 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:34.354682 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348880 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348883 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348885 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348888 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348892 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348894 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348897 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348900 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348902 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348905 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348907 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348910 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348912 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348915 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348918 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348920 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348923 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348926 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348928 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:34.355151 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348931 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348934 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348936 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348939 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348942 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348944 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348947 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348949 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348952 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348955 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348957 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348960 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348962 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348965 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348967 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348970 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:34.355648 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.348974 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.348981 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.355901 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.355917 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355967 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355972 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355976 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355979 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355983 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355986 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355989 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355992 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355995 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.355997 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356000 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356003 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:34.356034 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356005 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356012 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356014 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356017 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356021 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356025 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356028 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356030 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356033 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356036 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356039 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356041 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356044 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356048 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356050 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356053 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356056 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356058 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356061 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356064 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:34.356486 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356066 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356069 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356071 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356074 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356076 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356078 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356081 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356083 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356086 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356088 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356091 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356093 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356096 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356098 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356102 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356105 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356108 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356110 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356113 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356115 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:34.357084 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356118 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356121 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356124 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356127 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356132 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356135 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356138 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356141 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356144 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356147 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356149 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356152 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356155 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356157 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356160 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356162 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356165 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356167 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356170 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:34.357580 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356173 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356175 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356178 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356181 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356183 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356186 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356189 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356206 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356210 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356214 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356216 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356219 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356222 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356224 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356227 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:34.358033 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.356232 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356332 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356337 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356340 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356343 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356346 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356348 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356351 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356355 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356357 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356360 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356363 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356366 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356369 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356372 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356374 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356377 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356379 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356382 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356385 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356387 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 00:19:34.358435 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356390 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356393 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356395 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356400 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356404 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356408 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356411 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356414 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356417 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356420 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356424 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356428 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356431 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356433 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356436 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356439 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356442 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356445 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356448 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 00:19:34.358930 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356450 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356453 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356456 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356458 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356461 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356464 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356466 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356469 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356472 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356474 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356477 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356479 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356481 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356484 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356487 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356489 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356492 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356495 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356498 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 00:19:34.359415 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356501 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356504 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356507 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356509 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356512 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356515 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356517 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356520 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356522 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356525 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356527 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356530 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356532 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356535 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356537 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356540 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356542 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356545 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356548 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356550 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 00:19:34.359873 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356552 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356555 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356558 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356560 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356563 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356566 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356568 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:34.356571 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.356576 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 00:19:34.360469 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.357320 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 00:19:34.363009 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.362995 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 00:19:34.363753 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.363742 2574 server.go:1019] "Starting client certificate rotation" Jun 03 00:19:34.363855 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.363838 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 00:19:34.363891 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.363876 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 00:19:34.388880 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.388857 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 00:19:34.393862 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.393838 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 00:19:34.414783 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.414760 2574 log.go:25] "Validated CRI v1 runtime API" Jun 03 00:19:34.424099 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.424079 2574 log.go:25] "Validated CRI v1 image API" Jun 03 00:19:34.425800 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.425776 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 00:19:34.430040 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.430016 2574 fs.go:135] Filesystem UUIDs: map[204a92a7-f0c6-493a-b190-e37a7d4b4966:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9aa27fc6-e684-4bae-8769-ba973d39a9e5:/dev/nvme0n1p3] Jun 03 00:19:34.430129 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.430037 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 00:19:34.431379 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.431353 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 00:19:34.434516 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.434405 2574 manager.go:217] Machine: {Timestamp:2026-06-03 00:19:34.433894156 +0000 UTC m=+0.521702112 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099519 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ae1f4ad45e9a2edcdd892167f7624 SystemUUID:ec2ae1f4-ad45-e9a2-edcd-d892167f7624 BootID:dddb51d5-6426-4693-9e99-bbbe435686b6 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:8b:55:82:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:8b:55:82:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:ec:44:1a:a2:23 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 00:19:34.435590 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.435576 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 00:19:34.435712 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.435696 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 00:19:34.439151 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.439126 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 00:19:34.439308 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.439153 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-183.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 00:19:34.439362 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.439321 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 00:19:34.439362 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.439329 2574 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 00:19:34.439362 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.439336 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 00:19:34.439362 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.439353 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 00:19:34.442177 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.442166 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 00:19:34.442313 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.442304 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 00:19:34.445633 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.445622 2574 kubelet.go:491] "Attempting to sync node with API server" Jun 03 00:19:34.445669 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.445637 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 00:19:34.445669 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.445649 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 00:19:34.445669 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.445659 2574 kubelet.go:397] "Adding apiserver pod source" Jun 03 00:19:34.445795 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.445711 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 00:19:34.447153 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.447140 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 00:19:34.447214 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.447159 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 00:19:34.450988 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.450968 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 00:19:34.454365 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.454350 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 00:19:34.457992 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.457976 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.457998 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458006 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458011 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458020 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458025 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458031 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458036 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458047 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458053 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 00:19:34.458067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458062 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 00:19:34.458375 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.458074 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 00:19:34.459135 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.459123 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 00:19:34.459187 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.459143 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 00:19:34.459613 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.459586 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 00:19:34.459659 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.459589 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 00:19:34.462369 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.462355 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 00:19:34.462463 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.462454 2574 server.go:1295] "Started kubelet" Jun 03 00:19:34.462572 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.462538 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 00:19:34.462572 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.462533 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 00:19:34.462772 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.462585 2574 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 00:19:34.463326 ip-10-0-129-183 systemd[1]: Started Kubernetes Kubelet. Jun 03 00:19:34.464461 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.464447 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 00:19:34.466010 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.465996 2574 server.go:317] "Adding debug handlers to kubelet server" Jun 03 00:19:34.474506 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.474470 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zjcc4" Jun 03 00:19:34.476455 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.476433 2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-183.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 00:19:34.477626 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.477609 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zjcc4" Jun 03 00:19:34.477708 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.476431 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-183.ec2.internal.18b56a2e399a8800 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-183.ec2.internal,UID:ip-10-0-129-183.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-183.ec2.internal,},FirstTimestamp:2026-06-03 00:19:34.462367744 +0000 UTC m=+0.550175700,LastTimestamp:2026-06-03 00:19:34.462367744 +0000 UTC m=+0.550175700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-183.ec2.internal,}" Jun 03 00:19:34.481502 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.481475 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 00:19:34.484326 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.484311 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 00:19:34.484385 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.484339 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 00:19:34.484385 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.484382 2574 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 00:19:34.484471 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.484389 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 00:19:34.484471 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.484427 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 00:19:34.484570 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.484553 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 03 00:19:34.484570 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.484561 2574 reconciler.go:26] "Reconciler: start to sync state" Jun 03 00:19:34.485045 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.485018 2574 factory.go:55] Registering systemd factory Jun 03 00:19:34.485045 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.485037 2574 factory.go:223] Registration of the systemd container factory successfully Jun 03 00:19:34.485281 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.485261 2574 factory.go:153] Registering CRI-O factory Jun 03 00:19:34.485281 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.485282 2574 factory.go:223] Registration of the crio container factory successfully Jun 03 00:19:34.485449 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.485335 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 00:19:34.485449 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.485358 2574 factory.go:103] Registering Raw factory Jun 03 00:19:34.485449 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.485373 2574 manager.go:1196] Started watching for new ooms in manager Jun 03 00:19:34.485569 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.485535 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:34.485837 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.485813 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 00:19:34.485907 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.485868 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-183.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 00:19:34.486871 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.486856 2574 manager.go:319] Starting recovery of all containers Jun 03 00:19:34.495252 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.495091 2574 manager.go:324] Recovery completed Jun 03 00:19:34.499838 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.499819 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:34.501864 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.501847 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:34.501957 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.501883 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:34.501957 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.501897 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:34.502460 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.502448 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 00:19:34.502460 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.502460 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 00:19:34.502579 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.502479 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 00:19:34.506349 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.506334 2574 policy_none.go:49] "None policy: Start" Jun 03 00:19:34.506432 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.506356 2574 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 00:19:34.506432 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.506374 2574 state_mem.go:35] "Initializing new in-memory state store" Jun 03 00:19:34.548845 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.548825 2574 manager.go:341] "Starting Device Plugin manager" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.548875 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.548887 2574 server.go:85] "Starting device plugin registration server" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.549176 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.549188 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.549334 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.549425 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.549437 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.549928 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 00:19:34.569876 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.549968 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:34.616741 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.616630 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 00:19:34.617927 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.617912 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 00:19:34.618016 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.617942 2574 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 00:19:34.618016 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.617968 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 00:19:34.618016 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.617977 2574 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 00:19:34.618145 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.618022 2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 00:19:34.622550 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.622525 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:34.649684 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.649658 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:34.650671 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.650654 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:34.650757 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.650682 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:34.650757 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.650693 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:34.650757 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.650722 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.659409 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.659391 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.659468 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.659414 2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-183.ec2.internal\": node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:34.681723 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.681700 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:34.718543 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.718513 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal"] Jun 03 00:19:34.718619 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.718607 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:34.720091 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.720076 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:34.720141 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.720105 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:34.720141 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.720115 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:34.721420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.721408 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:34.721606 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.721591 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.721678 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.721623 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:34.722212 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.722182 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:34.722326 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.722187 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:34.722326 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.722233 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:34.722326 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.722247 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:34.722326 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.722254 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:34.722326 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.722270 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:34.723376 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.723362 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.723423 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.723386 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 00:19:34.724057 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.724042 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientMemory" Jun 03 00:19:34.724142 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.724071 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 00:19:34.724142 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.724087 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeHasSufficientPID" Jun 03 00:19:34.737747 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.737722 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-183.ec2.internal\" not found" node="ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.741964 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.741948 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-183.ec2.internal\" not found" node="ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.781971 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.781946 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:34.786286 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.786267 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10a84c2033299cd58d5c7ab25b52802e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"10a84c2033299cd58d5c7ab25b52802e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.786350 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.786294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10a84c2033299cd58d5c7ab25b52802e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"10a84c2033299cd58d5c7ab25b52802e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.786350 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.786312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/626dfd556dd473bd24bb26139b71b711-config\") pod \"kube-apiserver-proxy-ip-10-0-129-183.ec2.internal\" (UID: \"626dfd556dd473bd24bb26139b71b711\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.882319 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.882254 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:34.886538 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.886524 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10a84c2033299cd58d5c7ab25b52802e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"10a84c2033299cd58d5c7ab25b52802e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.886588 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.886563 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10a84c2033299cd58d5c7ab25b52802e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"10a84c2033299cd58d5c7ab25b52802e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.886621 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.886587 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/626dfd556dd473bd24bb26139b71b711-config\") pod \"kube-apiserver-proxy-ip-10-0-129-183.ec2.internal\" (UID: \"626dfd556dd473bd24bb26139b71b711\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.886621 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.886598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/10a84c2033299cd58d5c7ab25b52802e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"10a84c2033299cd58d5c7ab25b52802e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.886690 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.886623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/626dfd556dd473bd24bb26139b71b711-config\") pod \"kube-apiserver-proxy-ip-10-0-129-183.ec2.internal\" (UID: \"626dfd556dd473bd24bb26139b71b711\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.886690 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:34.886678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10a84c2033299cd58d5c7ab25b52802e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal\" (UID: \"10a84c2033299cd58d5c7ab25b52802e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:34.983010 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:34.982959 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.040434 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.040408 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:35.045131 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.045106 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" Jun 03 00:19:35.083788 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.083760 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.184293 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.184190 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.284682 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.284652 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.364028 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.363983 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 00:19:35.364577 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.364212 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 00:19:35.385171 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.385134 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.482655 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.482619 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 00:14:34 +0000 UTC" deadline="2027-12-08 09:41:52.588443264 +0000 UTC" Jun 03 00:19:35.482655 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.482653 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13281h22m17.105793741s" Jun 03 00:19:35.484987 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.484969 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 00:19:35.485415 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.485400 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.499586 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.499559 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 00:19:35.551351 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.551321 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ncvr" Jun 03 00:19:35.556505 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.556478 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7ncvr" Jun 03 00:19:35.570477 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:35.570445 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod626dfd556dd473bd24bb26139b71b711.slice/crio-1ae21227d0a1637ed7d7df0d6836fd5d9b22a1a70988e2cc882e7696cc4588f0 WatchSource:0}: Error finding container 1ae21227d0a1637ed7d7df0d6836fd5d9b22a1a70988e2cc882e7696cc4588f0: Status 404 returned error can't find the container with id 1ae21227d0a1637ed7d7df0d6836fd5d9b22a1a70988e2cc882e7696cc4588f0 Jun 03 00:19:35.572313 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:35.572291 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10a84c2033299cd58d5c7ab25b52802e.slice/crio-ca0dfc52c33f209bd92a3fc70ced7bc9218b17f3a73d14325d93796e9a9d0deb WatchSource:0}: Error finding container ca0dfc52c33f209bd92a3fc70ced7bc9218b17f3a73d14325d93796e9a9d0deb: Status 404 returned error can't find the container with id ca0dfc52c33f209bd92a3fc70ced7bc9218b17f3a73d14325d93796e9a9d0deb Jun 03 00:19:35.575129 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.574966 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:19:35.585576 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.585554 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.620661 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.620616 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" event={"ID":"10a84c2033299cd58d5c7ab25b52802e","Type":"ContainerStarted","Data":"ca0dfc52c33f209bd92a3fc70ced7bc9218b17f3a73d14325d93796e9a9d0deb"} Jun 03 00:19:35.621471 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.621448 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" event={"ID":"626dfd556dd473bd24bb26139b71b711","Type":"ContainerStarted","Data":"1ae21227d0a1637ed7d7df0d6836fd5d9b22a1a70988e2cc882e7696cc4588f0"} Jun 03 00:19:35.685776 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.685742 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.786151 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.786069 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.800108 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.800084 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:35.846437 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.846405 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:35.886461 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.886430 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.987147 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:35.987107 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-183.ec2.internal\" not found" Jun 03 00:19:35.997001 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:35.996980 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:36.085175 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.085093 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" Jun 03 00:19:36.095832 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.095808 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 00:19:36.096617 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.096603 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" Jun 03 00:19:36.106996 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.106966 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 00:19:36.447426 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.447341 2574 apiserver.go:52] "Watching apiserver" Jun 03 00:19:36.457029 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.454129 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 00:19:36.457029 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.456000 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-45fpl","kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9g2ws","openshift-dns/node-resolver-f8hvl","openshift-multus/network-metrics-daemon-8hgnw","openshift-network-diagnostics/network-check-target-tmngv","openshift-ovn-kubernetes/ovnkube-node-f8zgw","kube-system/konnectivity-agent-bfhvp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l","openshift-image-registry/node-ca-ndzr2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal","openshift-multus/multus-2tc8k","openshift-multus/multus-additional-cni-plugins-wqmj8","openshift-network-operator/iptables-alerter-2s8zv"] Jun 03 00:19:36.458931 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.458865 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.458931 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.458920 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.459935 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.459915 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.460941 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.460921 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.461535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.461516 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wtk9b\"" Jun 03 00:19:36.462512 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.461907 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:19:36.462512 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.462353 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 00:19:36.462714 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.462577 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 00:19:36.462714 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.462582 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 00:19:36.462940 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.462750 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 00:19:36.463041 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.462978 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4hv6w\"" Jun 03 00:19:36.463041 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.463024 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f5wsm\"" Jun 03 00:19:36.463238 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.462981 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 00:19:36.463238 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.463109 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2kcqs\"" Jun 03 00:19:36.463238 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.463232 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 00:19:36.464672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.464099 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:19:36.464672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.464367 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:36.464672 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.464427 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:36.464672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.464648 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 00:19:36.465009 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.464691 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 00:19:36.465009 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.464737 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 00:19:36.465009 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.464648 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 00:19:36.465009 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.464974 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 00:19:36.466300 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.465953 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.468155 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.468133 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 00:19:36.468523 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.468365 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n27wc\"" Jun 03 00:19:36.468620 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.468146 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:36.470284 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.469680 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.470284 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.469685 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.470738 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.470710 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 00:19:36.470992 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.470977 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fvfvl\"" Jun 03 00:19:36.471067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.470996 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 00:19:36.471342 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.471282 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.472190 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.472041 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 00:19:36.472393 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.472372 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c4gcp\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.472788 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473014 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473054 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473267 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8bmbf\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473312 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473312 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473435 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473503 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 00:19:36.473651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473602 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 00:19:36.474110 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473718 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cztjr\"" Jun 03 00:19:36.474110 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.473818 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 00:19:36.474597 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.474293 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 00:19:36.474597 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.474423 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.474597 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.474486 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:36.474597 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.474509 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:36.474597 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.474566 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:36.485962 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.485624 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 00:19:36.493084 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493059 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.493170 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-system-cni-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.493170 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-kubernetes\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.493170 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tbr7\" (UniqueName: \"kubernetes.io/projected/754c1b71-4865-43d6-ab7d-982df313977c-kube-api-access-9tbr7\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.493344 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01b66153-7b87-414b-8b51-1d96488e7f8a-kubelet-config\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.493344 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.493344 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-daemon-config\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.493344 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-etc-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.493344 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493297 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-socket-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.493344 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-host-slash\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.493344 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493339 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z95n\" (UniqueName: \"kubernetes.io/projected/5819615f-aa8e-4984-bb02-29088c6d02a1-kube-api-access-9z95n\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lxqn\" (UniqueName: \"kubernetes.io/projected/b7b24aa7-3804-471c-a6ed-f4d332b281b6-kube-api-access-5lxqn\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493423 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-kubelet\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493457 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx2gl\" (UniqueName: \"kubernetes.io/projected/3c455288-52d8-48a5-8839-0bc3c874c168-kube-api-access-jx2gl\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysctl-d\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493503 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-cni-multus\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493541 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-cnibin\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-etc-kubernetes\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-env-overrides\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dde7c0f-7852-44c4-a696-0a3b284f4081-konnectivity-ca\") pod \"konnectivity-agent-bfhvp\" (UID: \"1dde7c0f-7852-44c4-a696-0a3b284f4081\") " pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493638 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.493667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-sys-fs\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493684 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-cnibin\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-k8s-cni-cncf-io\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-run-netns\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493742 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-var-lib-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493783 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-run\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493803 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-var-lib-kubelet\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dddf5323-7f89-4532-9f0a-fa533317664a-etc-tuned\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-socket-dir-parent\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493857 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-hostroot\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-cni-netd\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493893 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tbq7\" (UniqueName: \"kubernetes.io/projected/e026d09a-f61c-4a8d-9b09-9ca40ba38592-kube-api-access-2tbq7\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.494272 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.493911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysctl-conf\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494467 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-systemd\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-slash\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysconfig\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494540 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dddf5323-7f89-4532-9f0a-fa533317664a-tmp\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01b66153-7b87-414b-8b51-1d96488e7f8a-dbus\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-iptables-alerter-script\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxzjk\" (UniqueName: \"kubernetes.io/projected/dddf5323-7f89-4532-9f0a-fa533317664a-kube-api-access-gxzjk\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/754c1b71-4865-43d6-ab7d-982df313977c-host\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494747 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-multus-certs\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-systemd\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494838 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-system-cni-dir\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.494860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494864 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-cni-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/212d59ce-03c1-4171-bd89-367abf0c31f5-ovn-node-metrics-cert\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-host\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-netns\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.494970 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-log-socket\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495002 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495026 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-registration-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495049 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-ovnkube-config\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzn2m\" (UniqueName: \"kubernetes.io/projected/212d59ce-03c1-4171-bd89-367abf0c31f5-kube-api-access-tzn2m\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495119 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-etc-selinux\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dde7c0f-7852-44c4-a696-0a3b284f4081-agent-certs\") pod \"konnectivity-agent-bfhvp\" (UID: \"1dde7c0f-7852-44c4-a696-0a3b284f4081\") " pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495181 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-device-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-lib-modules\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.495467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495278 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-node-log\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.496001 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c455288-52d8-48a5-8839-0bc3c874c168-hosts-file\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.496052 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.495998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-sys\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.496688 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.496463 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/754c1b71-4865-43d6-ab7d-982df313977c-serviceca\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.496797 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.496702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-os-release\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.496908 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.496773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:36.496969 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.496929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-os-release\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.497707 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.497570 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7b24aa7-3804-471c-a6ed-f4d332b281b6-cni-binary-copy\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.497787 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.497719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-ovnkube-script-lib\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.497853 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.497788 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c455288-52d8-48a5-8839-0bc3c874c168-tmp-dir\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.497972 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.497928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-modprobe-d\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.501107 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.500229 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-conf-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.502058 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.501844 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-systemd-units\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.502058 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.501895 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-ovn\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.502058 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.501922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-cni-bin\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.502058 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.501956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-cni-bin\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.502058 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.501999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-kubelet\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.502496 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.502066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnpws\" (UniqueName: \"kubernetes.io/projected/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-kube-api-access-rnpws\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.502496 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.502100 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.502496 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.502160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69hwf\" (UniqueName: \"kubernetes.io/projected/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-kube-api-access-69hwf\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:36.557606 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.557572 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:14:35 +0000 UTC" deadline="2028-02-20 13:09:31.317062838 +0000 UTC" Jun 03 00:19:36.557606 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.557606 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15060h49m54.759459776s" Jun 03 00:19:36.602463 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602426 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-slash\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.602608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602472 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysconfig\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.602608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602499 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dddf5323-7f89-4532-9f0a-fa533317664a-tmp\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.602608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602506 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-slash\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.602608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602526 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:36.602608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602549 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01b66153-7b87-414b-8b51-1d96488e7f8a-dbus\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.602608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602568 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysconfig\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.602608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602576 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-iptables-alerter-script\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.602608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602601 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gxzjk\" (UniqueName: \"kubernetes.io/projected/dddf5323-7f89-4532-9f0a-fa533317664a-kube-api-access-gxzjk\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602622 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/754c1b71-4865-43d6-ab7d-982df313977c-host\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602644 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-multus-certs\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602667 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-systemd\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602709 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/01b66153-7b87-414b-8b51-1d96488e7f8a-dbus\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602690 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602748 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-system-cni-dir\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602775 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-cni-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.602795 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602800 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/212d59ce-03c1-4171-bd89-367abf0c31f5-ovn-node-metrics-cert\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602823 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-host\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602826 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-system-cni-dir\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.602881 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret podName:01b66153-7b87-414b-8b51-1d96488e7f8a nodeName:}" failed. No retries permitted until 2026-06-03 00:19:37.102842675 +0000 UTC m=+3.190650620 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret") pod "global-pull-secret-syncer-45fpl" (UID: "01b66153-7b87-414b-8b51-1d96488e7f8a") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602887 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602901 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-netns\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602931 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-multus-certs\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-host\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.602990 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602931 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-log-socket\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602987 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603021 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-registration-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603048 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-ovnkube-config\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603053 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603074 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzn2m\" (UniqueName: \"kubernetes.io/projected/212d59ce-03c1-4171-bd89-367abf0c31f5-kube-api-access-tzn2m\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603092 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-systemd\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603098 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-etc-selinux\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603124 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-iptables-alerter-script\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-netns\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603022 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-log-socket\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-cni-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.602991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/754c1b71-4865-43d6-ab7d-982df313977c-host\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603129 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dde7c0f-7852-44c4-a696-0a3b284f4081-agent-certs\") pod \"konnectivity-agent-bfhvp\" (UID: \"1dde7c0f-7852-44c4-a696-0a3b284f4081\") " pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603184 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-device-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-registration-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603232 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-lib-modules\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.603700 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603260 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-device-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603262 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-node-log\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603294 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-node-log\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603296 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-etc-selinux\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603300 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c455288-52d8-48a5-8839-0bc3c874c168-hosts-file\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603331 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-lib-modules\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603343 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-sys\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603344 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3c455288-52d8-48a5-8839-0bc3c874c168-hosts-file\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603376 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/754c1b71-4865-43d6-ab7d-982df313977c-serviceca\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-sys\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603417 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-os-release\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603447 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603479 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-os-release\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603503 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7b24aa7-3804-471c-a6ed-f4d332b281b6-cni-binary-copy\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-os-release\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.603550 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603530 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-ovnkube-script-lib\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603584 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c455288-52d8-48a5-8839-0bc3c874c168-tmp-dir\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.604450 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-os-release\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.603610 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs podName:3b116e3e-08e8-4935-8ae4-8a9b932a43b3 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:37.103594961 +0000 UTC m=+3.191402923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs") pod "network-metrics-daemon-8hgnw" (UID: "3b116e3e-08e8-4935-8ae4-8a9b932a43b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603629 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-modprobe-d\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603668 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-conf-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603692 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-systemd-units\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603731 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-ovn\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603761 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-ovnkube-config\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603773 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-cni-bin\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603777 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/754c1b71-4865-43d6-ab7d-982df313977c-serviceca\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603811 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-cni-bin\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603827 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-cni-bin\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603840 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-kubelet\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603866 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rnpws\" (UniqueName: \"kubernetes.io/projected/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-kube-api-access-rnpws\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-modprobe-d\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603896 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c455288-52d8-48a5-8839-0bc3c874c168-tmp-dir\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603915 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-systemd-units\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.605295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603923 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-69hwf\" (UniqueName: \"kubernetes.io/projected/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-kube-api-access-69hwf\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603957 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-kubelet\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603973 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-conf-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.603996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-cni-bin\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604000 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-system-cni-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604031 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-kubernetes\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604058 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tbr7\" (UniqueName: \"kubernetes.io/projected/754c1b71-4865-43d6-ab7d-982df313977c-kube-api-access-9tbr7\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604108 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01b66153-7b87-414b-8b51-1d96488e7f8a-kubelet-config\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604135 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b7b24aa7-3804-471c-a6ed-f4d332b281b6-cni-binary-copy\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604181 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-kubernetes\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604243 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-run-ovn\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604289 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-system-cni-dir\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604310 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/01b66153-7b87-414b-8b51-1d96488e7f8a-kubelet-config\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604349 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-daemon-config\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604375 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-etc-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.606075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604385 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-ovnkube-script-lib\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604400 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-socket-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604408 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604427 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-host-slash\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604450 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-etc-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604454 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604489 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-host-slash\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604490 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9z95n\" (UniqueName: \"kubernetes.io/projected/5819615f-aa8e-4984-bb02-29088c6d02a1-kube-api-access-9z95n\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-socket-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604523 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5lxqn\" (UniqueName: \"kubernetes.io/projected/b7b24aa7-3804-471c-a6ed-f4d332b281b6-kube-api-access-5lxqn\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604561 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-kubelet\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604586 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jx2gl\" (UniqueName: \"kubernetes.io/projected/3c455288-52d8-48a5-8839-0bc3c874c168-kube-api-access-jx2gl\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604611 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysctl-d\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604635 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-cni-multus\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604664 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604688 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-cnibin\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604690 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.606758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604713 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-etc-kubernetes\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-kubelet\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604812 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysctl-d\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604826 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-daemon-config\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604836 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-etc-kubernetes\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604836 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5819615f-aa8e-4984-bb02-29088c6d02a1-cnibin\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604848 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-env-overrides\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-var-lib-cni-multus\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604880 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dde7c0f-7852-44c4-a696-0a3b284f4081-konnectivity-ca\") pod \"konnectivity-agent-bfhvp\" (UID: \"1dde7c0f-7852-44c4-a696-0a3b284f4081\") " pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604919 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604943 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-sys-fs\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604966 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-cnibin\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.604991 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-k8s-cni-cncf-io\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605032 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-run-netns\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605058 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-var-lib-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605083 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.607297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605110 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-run\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605137 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605153 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-var-lib-kubelet\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605181 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dddf5323-7f89-4532-9f0a-fa533317664a-etc-tuned\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605212 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e026d09a-f61c-4a8d-9b09-9ca40ba38592-sys-fs\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605221 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-socket-dir-parent\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605229 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/212d59ce-03c1-4171-bd89-367abf0c31f5-env-overrides\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605248 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-hostroot\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-host-run-k8s-cni-cncf-io\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605273 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-cni-netd\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605301 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-run-netns\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605318 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tbq7\" (UniqueName: \"kubernetes.io/projected/e026d09a-f61c-4a8d-9b09-9ca40ba38592-kube-api-access-2tbq7\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605324 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-cnibin\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605344 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysctl-conf\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605370 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-systemd\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-run\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605378 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1dde7c0f-7852-44c4-a696-0a3b284f4081-konnectivity-ca\") pod \"konnectivity-agent-bfhvp\" (UID: \"1dde7c0f-7852-44c4-a696-0a3b284f4081\") " pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-hostroot\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.607879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605411 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-run-ovn-kubernetes\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605455 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-systemd\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605462 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b7b24aa7-3804-471c-a6ed-f4d332b281b6-multus-socket-dir-parent\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605347 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-var-lib-openvswitch\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-var-lib-kubelet\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605566 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/212d59ce-03c1-4171-bd89-367abf0c31f5-host-cni-netd\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dddf5323-7f89-4532-9f0a-fa533317664a-etc-sysctl-conf\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.605892 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5819615f-aa8e-4984-bb02-29088c6d02a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.606529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dddf5323-7f89-4532-9f0a-fa533317664a-tmp\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.606784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1dde7c0f-7852-44c4-a696-0a3b284f4081-agent-certs\") pod \"konnectivity-agent-bfhvp\" (UID: \"1dde7c0f-7852-44c4-a696-0a3b284f4081\") " pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.607569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dddf5323-7f89-4532-9f0a-fa533317664a-etc-tuned\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.608410 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.607718 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/212d59ce-03c1-4171-bd89-367abf0c31f5-ovn-node-metrics-cert\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.611303 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.611280 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:36.611303 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.611303 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:36.611446 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.611317 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qrsgn for pod openshift-network-diagnostics/network-check-target-tmngv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:36.611446 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:36.611373 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn podName:03fb21a5-15bb-4eee-80d1-c368a2a50300 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:37.111357984 +0000 UTC m=+3.199165931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qrsgn" (UniqueName: "kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn") pod "network-check-target-tmngv" (UID: "03fb21a5-15bb-4eee-80d1-c368a2a50300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:36.613361 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.613341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxzjk\" (UniqueName: \"kubernetes.io/projected/dddf5323-7f89-4532-9f0a-fa533317664a-kube-api-access-gxzjk\") pod \"tuned-9g2ws\" (UID: \"dddf5323-7f89-4532-9f0a-fa533317664a\") " pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.615999 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.615976 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx2gl\" (UniqueName: \"kubernetes.io/projected/3c455288-52d8-48a5-8839-0bc3c874c168-kube-api-access-jx2gl\") pod \"node-resolver-f8hvl\" (UID: \"3c455288-52d8-48a5-8839-0bc3c874c168\") " pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.616118 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.616064 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tbr7\" (UniqueName: \"kubernetes.io/projected/754c1b71-4865-43d6-ab7d-982df313977c-kube-api-access-9tbr7\") pod \"node-ca-ndzr2\" (UID: \"754c1b71-4865-43d6-ab7d-982df313977c\") " pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.616182 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.616116 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tbq7\" (UniqueName: \"kubernetes.io/projected/e026d09a-f61c-4a8d-9b09-9ca40ba38592-kube-api-access-2tbq7\") pod \"aws-ebs-csi-driver-node-9cs8l\" (UID: \"e026d09a-f61c-4a8d-9b09-9ca40ba38592\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.616182 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.616130 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnpws\" (UniqueName: \"kubernetes.io/projected/4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc-kube-api-access-rnpws\") pod \"iptables-alerter-2s8zv\" (UID: \"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc\") " pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.616324 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.616302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z95n\" (UniqueName: \"kubernetes.io/projected/5819615f-aa8e-4984-bb02-29088c6d02a1-kube-api-access-9z95n\") pod \"multus-additional-cni-plugins-wqmj8\" (UID: \"5819615f-aa8e-4984-bb02-29088c6d02a1\") " pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.616619 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.616588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lxqn\" (UniqueName: \"kubernetes.io/projected/b7b24aa7-3804-471c-a6ed-f4d332b281b6-kube-api-access-5lxqn\") pod \"multus-2tc8k\" (UID: \"b7b24aa7-3804-471c-a6ed-f4d332b281b6\") " pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.616924 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.616906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzn2m\" (UniqueName: \"kubernetes.io/projected/212d59ce-03c1-4171-bd89-367abf0c31f5-kube-api-access-tzn2m\") pod \"ovnkube-node-f8zgw\" (UID: \"212d59ce-03c1-4171-bd89-367abf0c31f5\") " pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.617850 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.617798 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69hwf\" (UniqueName: \"kubernetes.io/projected/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-kube-api-access-69hwf\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:36.640780 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.640755 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 00:19:36.783286 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.783169 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2s8zv" Jun 03 00:19:36.789156 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.789131 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" Jun 03 00:19:36.790177 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.790145 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d2c5118_1d5f_4974_aaaa_f6b24fcc09bc.slice/crio-c9717090570c8db9bb963f356c10529d37540b8dd20a21e11c22c8694b6a9741 WatchSource:0}: Error finding container c9717090570c8db9bb963f356c10529d37540b8dd20a21e11c22c8694b6a9741: Status 404 returned error can't find the container with id c9717090570c8db9bb963f356c10529d37540b8dd20a21e11c22c8694b6a9741 Jun 03 00:19:36.795917 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.795892 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode026d09a_f61c_4a8d_9b09_9ca40ba38592.slice/crio-8e847cfe1d1ac3679beff1386028a666f500ef8944d926e1de0900588a998755 WatchSource:0}: Error finding container 8e847cfe1d1ac3679beff1386028a666f500ef8944d926e1de0900588a998755: Status 404 returned error can't find the container with id 8e847cfe1d1ac3679beff1386028a666f500ef8944d926e1de0900588a998755 Jun 03 00:19:36.799102 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.799086 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" Jun 03 00:19:36.804655 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.804634 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddddf5323_7f89_4532_9f0a_fa533317664a.slice/crio-f9cdeb5aef290dbe17ecd211feb14dcc54d0ba7390ec86819996af0efc2b3d34 WatchSource:0}: Error finding container f9cdeb5aef290dbe17ecd211feb14dcc54d0ba7390ec86819996af0efc2b3d34: Status 404 returned error can't find the container with id f9cdeb5aef290dbe17ecd211feb14dcc54d0ba7390ec86819996af0efc2b3d34 Jun 03 00:19:36.805698 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.805682 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" Jun 03 00:19:36.812444 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.812414 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5819615f_aa8e_4984_bb02_29088c6d02a1.slice/crio-575082af1e1a186fdc09eca37012c7c3f8caff7fc745e168212be80a7ae375ed WatchSource:0}: Error finding container 575082af1e1a186fdc09eca37012c7c3f8caff7fc745e168212be80a7ae375ed: Status 404 returned error can't find the container with id 575082af1e1a186fdc09eca37012c7c3f8caff7fc745e168212be80a7ae375ed Jun 03 00:19:36.813151 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.813130 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2tc8k" Jun 03 00:19:36.819395 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.819351 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b24aa7_3804_471c_a6ed_f4d332b281b6.slice/crio-cca8e34e1bbd655148c322a87cc8508fc82a41f5bf0bdb7a5820fd379e50c354 WatchSource:0}: Error finding container cca8e34e1bbd655148c322a87cc8508fc82a41f5bf0bdb7a5820fd379e50c354: Status 404 returned error can't find the container with id cca8e34e1bbd655148c322a87cc8508fc82a41f5bf0bdb7a5820fd379e50c354 Jun 03 00:19:36.820694 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.820672 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:36.827734 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.827711 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dde7c0f_7852_44c4_a696_0a3b284f4081.slice/crio-09fa63d23733a4b43274998ecaa32a61b55d78bbfbaecc4ed2390f2b22ac46c8 WatchSource:0}: Error finding container 09fa63d23733a4b43274998ecaa32a61b55d78bbfbaecc4ed2390f2b22ac46c8: Status 404 returned error can't find the container with id 09fa63d23733a4b43274998ecaa32a61b55d78bbfbaecc4ed2390f2b22ac46c8 Jun 03 00:19:36.827835 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.827776 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f8hvl" Jun 03 00:19:36.835463 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.835437 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c455288_52d8_48a5_8839_0bc3c874c168.slice/crio-f2b96e08d6e12c131f6efd993b2608e13a45cebc7f700c4b4d4bfc72b1eaf458 WatchSource:0}: Error finding container f2b96e08d6e12c131f6efd993b2608e13a45cebc7f700c4b4d4bfc72b1eaf458: Status 404 returned error can't find the container with id f2b96e08d6e12c131f6efd993b2608e13a45cebc7f700c4b4d4bfc72b1eaf458 Jun 03 00:19:36.836717 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.836660 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:19:36.841864 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:36.841846 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ndzr2" Jun 03 00:19:36.843166 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.843148 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212d59ce_03c1_4171_bd89_367abf0c31f5.slice/crio-e302f32298b87296fe37b8daae770292a12034042173a3af4e8972a99b5db1d9 WatchSource:0}: Error finding container e302f32298b87296fe37b8daae770292a12034042173a3af4e8972a99b5db1d9: Status 404 returned error can't find the container with id e302f32298b87296fe37b8daae770292a12034042173a3af4e8972a99b5db1d9 Jun 03 00:19:36.848037 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:19:36.848018 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754c1b71_4865_43d6_ab7d_982df313977c.slice/crio-b13cc688ff1ed1de02a8585803d134464df96f9d3743334f5669a6acc019911f WatchSource:0}: Error finding container b13cc688ff1ed1de02a8585803d134464df96f9d3743334f5669a6acc019911f: Status 404 returned error can't find the container with id b13cc688ff1ed1de02a8585803d134464df96f9d3743334f5669a6acc019911f Jun 03 00:19:37.108533 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.108426 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:37.108533 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.108520 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:37.108768 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.108546 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:37.108768 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.108624 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs podName:3b116e3e-08e8-4935-8ae4-8a9b932a43b3 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:38.108600327 +0000 UTC m=+4.196408291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs") pod "network-metrics-daemon-8hgnw" (UID: "3b116e3e-08e8-4935-8ae4-8a9b932a43b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:37.108768 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.108648 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:37.108768 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.108691 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret podName:01b66153-7b87-414b-8b51-1d96488e7f8a nodeName:}" failed. No retries permitted until 2026-06-03 00:19:38.10868043 +0000 UTC m=+4.196488372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret") pod "global-pull-secret-syncer-45fpl" (UID: "01b66153-7b87-414b-8b51-1d96488e7f8a") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:37.209094 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.209063 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:37.209297 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.209258 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:37.209297 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.209280 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:37.209297 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.209291 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qrsgn for pod openshift-network-diagnostics/network-check-target-tmngv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:37.209487 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.209351 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn podName:03fb21a5-15bb-4eee-80d1-c368a2a50300 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:38.209331737 +0000 UTC m=+4.297139686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qrsgn" (UniqueName: "kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn") pod "network-check-target-tmngv" (UID: "03fb21a5-15bb-4eee-80d1-c368a2a50300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:37.558310 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.558181 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 00:14:35 +0000 UTC" deadline="2028-01-15 09:16:07.028112783 +0000 UTC" Jun 03 00:19:37.558310 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.558236 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14192h56m29.469880355s" Jun 03 00:19:37.618591 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.618564 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:37.618743 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:37.618672 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:37.626838 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.626804 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bfhvp" event={"ID":"1dde7c0f-7852-44c4-a696-0a3b284f4081","Type":"ContainerStarted","Data":"09fa63d23733a4b43274998ecaa32a61b55d78bbfbaecc4ed2390f2b22ac46c8"} Jun 03 00:19:37.628435 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.628405 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ndzr2" event={"ID":"754c1b71-4865-43d6-ab7d-982df313977c","Type":"ContainerStarted","Data":"b13cc688ff1ed1de02a8585803d134464df96f9d3743334f5669a6acc019911f"} Jun 03 00:19:37.629659 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.629626 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tc8k" event={"ID":"b7b24aa7-3804-471c-a6ed-f4d332b281b6","Type":"ContainerStarted","Data":"cca8e34e1bbd655148c322a87cc8508fc82a41f5bf0bdb7a5820fd379e50c354"} Jun 03 00:19:37.630668 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.630645 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" event={"ID":"5819615f-aa8e-4984-bb02-29088c6d02a1","Type":"ContainerStarted","Data":"575082af1e1a186fdc09eca37012c7c3f8caff7fc745e168212be80a7ae375ed"} Jun 03 00:19:37.631596 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.631575 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" event={"ID":"dddf5323-7f89-4532-9f0a-fa533317664a","Type":"ContainerStarted","Data":"f9cdeb5aef290dbe17ecd211feb14dcc54d0ba7390ec86819996af0efc2b3d34"} Jun 03 00:19:37.632542 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.632524 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" event={"ID":"e026d09a-f61c-4a8d-9b09-9ca40ba38592","Type":"ContainerStarted","Data":"8e847cfe1d1ac3679beff1386028a666f500ef8944d926e1de0900588a998755"} Jun 03 00:19:37.633571 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.633551 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2s8zv" event={"ID":"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc","Type":"ContainerStarted","Data":"c9717090570c8db9bb963f356c10529d37540b8dd20a21e11c22c8694b6a9741"} Jun 03 00:19:37.634541 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.634523 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"e302f32298b87296fe37b8daae770292a12034042173a3af4e8972a99b5db1d9"} Jun 03 00:19:37.635536 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:37.635516 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f8hvl" event={"ID":"3c455288-52d8-48a5-8839-0bc3c874c168","Type":"ContainerStarted","Data":"f2b96e08d6e12c131f6efd993b2608e13a45cebc7f700c4b4d4bfc72b1eaf458"} Jun 03 00:19:38.115714 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:38.115387 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:38.115714 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.115558 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:38.115926 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:38.115731 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:38.115926 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.115789 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs podName:3b116e3e-08e8-4935-8ae4-8a9b932a43b3 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:40.115760093 +0000 UTC m=+6.203568041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs") pod "network-metrics-daemon-8hgnw" (UID: "3b116e3e-08e8-4935-8ae4-8a9b932a43b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:38.116027 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.115951 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:38.116027 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.116004 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret podName:01b66153-7b87-414b-8b51-1d96488e7f8a nodeName:}" failed. No retries permitted until 2026-06-03 00:19:40.115988946 +0000 UTC m=+6.203796903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret") pod "global-pull-secret-syncer-45fpl" (UID: "01b66153-7b87-414b-8b51-1d96488e7f8a") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:38.217342 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:38.217224 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:38.217516 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.217450 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:38.217516 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.217469 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:38.217516 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.217481 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qrsgn for pod openshift-network-diagnostics/network-check-target-tmngv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:38.217673 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.217537 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn podName:03fb21a5-15bb-4eee-80d1-c368a2a50300 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:40.217518933 +0000 UTC m=+6.305326884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qrsgn" (UniqueName: "kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn") pod "network-check-target-tmngv" (UID: "03fb21a5-15bb-4eee-80d1-c368a2a50300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:38.620860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:38.620359 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:38.620860 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.620478 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:38.621946 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:38.621518 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:38.621946 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:38.621626 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:38.662456 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:38.662361 2574 generic.go:358] "Generic (PLEG): container finished" podID="10a84c2033299cd58d5c7ab25b52802e" containerID="ba299a045a93ab0b936670141caa11edc07ffeaeef3b369c053673df154e0f06" exitCode=0 Jun 03 00:19:38.662985 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:38.662959 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" event={"ID":"10a84c2033299cd58d5c7ab25b52802e","Type":"ContainerDied","Data":"ba299a045a93ab0b936670141caa11edc07ffeaeef3b369c053673df154e0f06"} Jun 03 00:19:38.671089 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:38.671054 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" event={"ID":"626dfd556dd473bd24bb26139b71b711","Type":"ContainerStarted","Data":"26ad16dd5669c147f30bc1cf957c74a6d6c2a2be7d2295e2ad5ff0063efc1510"} Jun 03 00:19:39.618266 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:39.618233 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:39.618459 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:39.618375 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:39.676849 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:39.676767 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" event={"ID":"10a84c2033299cd58d5c7ab25b52802e","Type":"ContainerStarted","Data":"c57de85795b3ef904c9f51058b4d54695359f595e66e1b99c07fb2f212d1f976"} Jun 03 00:19:39.694393 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:39.693372 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-183.ec2.internal" podStartSLOduration=3.693354239 podStartE2EDuration="3.693354239s" podCreationTimestamp="2026-06-03 00:19:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:19:38.693649165 +0000 UTC m=+4.781457132" watchObservedRunningTime="2026-06-03 00:19:39.693354239 +0000 UTC m=+5.781162205" Jun 03 00:19:40.137057 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:40.137020 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:40.137239 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:40.137076 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:40.137324 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.137238 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:40.137324 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.137297 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs podName:3b116e3e-08e8-4935-8ae4-8a9b932a43b3 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:44.137277828 +0000 UTC m=+10.225085772 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs") pod "network-metrics-daemon-8hgnw" (UID: "3b116e3e-08e8-4935-8ae4-8a9b932a43b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:40.137744 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.137724 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:40.137851 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.137781 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret podName:01b66153-7b87-414b-8b51-1d96488e7f8a nodeName:}" failed. No retries permitted until 2026-06-03 00:19:44.137764134 +0000 UTC m=+10.225572092 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret") pod "global-pull-secret-syncer-45fpl" (UID: "01b66153-7b87-414b-8b51-1d96488e7f8a") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:40.237580 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:40.237543 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:40.237768 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.237701 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:40.237768 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.237720 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:40.237768 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.237732 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qrsgn for pod openshift-network-diagnostics/network-check-target-tmngv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:40.237917 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.237791 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn podName:03fb21a5-15bb-4eee-80d1-c368a2a50300 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:44.237773346 +0000 UTC m=+10.325581291 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qrsgn" (UniqueName: "kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn") pod "network-check-target-tmngv" (UID: "03fb21a5-15bb-4eee-80d1-c368a2a50300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:40.619150 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:40.618887 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:40.619150 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.619039 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:40.619150 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:40.619053 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:40.619470 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:40.619210 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:41.619015 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:41.618544 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:41.619015 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:41.618681 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:42.618836 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:42.618666 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:42.618836 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:42.618666 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:42.618836 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:42.618807 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:42.619442 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:42.618908 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:43.618369 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:43.618328 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:43.618562 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:43.618478 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:44.167284 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:44.167247 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:44.167725 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:44.167338 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:44.167725 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.167406 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:44.167725 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.167453 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:44.167725 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.167485 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs podName:3b116e3e-08e8-4935-8ae4-8a9b932a43b3 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:52.167467467 +0000 UTC m=+18.255275415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs") pod "network-metrics-daemon-8hgnw" (UID: "3b116e3e-08e8-4935-8ae4-8a9b932a43b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:44.167725 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.167505 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret podName:01b66153-7b87-414b-8b51-1d96488e7f8a nodeName:}" failed. No retries permitted until 2026-06-03 00:19:52.167491475 +0000 UTC m=+18.255299421 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret") pod "global-pull-secret-syncer-45fpl" (UID: "01b66153-7b87-414b-8b51-1d96488e7f8a") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:44.268002 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:44.267964 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:44.268150 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.268130 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:44.268219 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.268151 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:44.268219 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.268162 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qrsgn for pod openshift-network-diagnostics/network-check-target-tmngv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:44.268304 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.268226 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn podName:03fb21a5-15bb-4eee-80d1-c368a2a50300 nodeName:}" failed. No retries permitted until 2026-06-03 00:19:52.268212563 +0000 UTC m=+18.356020506 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qrsgn" (UniqueName: "kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn") pod "network-check-target-tmngv" (UID: "03fb21a5-15bb-4eee-80d1-c368a2a50300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:44.619108 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:44.619074 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:44.619318 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:44.619074 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:44.619318 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.619184 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:44.619318 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:44.619275 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:45.618350 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:45.618306 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:45.618758 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:45.618436 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:46.618408 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:46.618374 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:46.618772 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:46.618505 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:46.621106 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:46.618374 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:46.621106 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:46.618928 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:47.618465 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.618217 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:47.619119 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:47.618591 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:47.694474 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.694432 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ndzr2" event={"ID":"754c1b71-4865-43d6-ab7d-982df313977c","Type":"ContainerStarted","Data":"ffa83cd61b25dce030f1f274ccfcbded22bb3ac7bd847cd7343d0ca2e594ddb4"} Jun 03 00:19:47.695924 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.695859 2574 generic.go:358] "Generic (PLEG): container finished" podID="5819615f-aa8e-4984-bb02-29088c6d02a1" containerID="769e1c6b489d246dab16af609171d56f2265536c76a2dfc51678b1d3c9f13fa7" exitCode=0 Jun 03 00:19:47.696142 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.695946 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" event={"ID":"5819615f-aa8e-4984-bb02-29088c6d02a1","Type":"ContainerDied","Data":"769e1c6b489d246dab16af609171d56f2265536c76a2dfc51678b1d3c9f13fa7"} Jun 03 00:19:47.698155 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.698119 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" event={"ID":"dddf5323-7f89-4532-9f0a-fa533317664a","Type":"ContainerStarted","Data":"b1da6d3b063382b242121623b15585c9d40e6695d925f201860edc59baeec18a"} Jun 03 00:19:47.699494 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.699473 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" event={"ID":"e026d09a-f61c-4a8d-9b09-9ca40ba38592","Type":"ContainerStarted","Data":"2463983ab38132b55bb91cc37f0d89f277008a7594f50422284552fe552397ca"} Jun 03 00:19:47.700529 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.700501 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f8hvl" event={"ID":"3c455288-52d8-48a5-8839-0bc3c874c168","Type":"ContainerStarted","Data":"597af69e0cc3a8f6b5c4400fae0066c65a3f45ce0177dd24821815c68fa5c500"} Jun 03 00:19:47.701495 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.701472 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bfhvp" event={"ID":"1dde7c0f-7852-44c4-a696-0a3b284f4081","Type":"ContainerStarted","Data":"37e5ae1240286fc9daf015f7ea26e2be2e33230b1397b2ab68c5884c22c7c0be"} Jun 03 00:19:47.708136 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.708097 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ndzr2" podStartSLOduration=3.009681671 podStartE2EDuration="12.708084325s" podCreationTimestamp="2026-06-03 00:19:35 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.849619635 +0000 UTC m=+2.937427578" lastFinishedPulling="2026-06-03 00:19:46.548022279 +0000 UTC m=+12.635830232" observedRunningTime="2026-06-03 00:19:47.707435392 +0000 UTC m=+13.795243356" watchObservedRunningTime="2026-06-03 00:19:47.708084325 +0000 UTC m=+13.795892304" Jun 03 00:19:47.708285 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.708168 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-183.ec2.internal" podStartSLOduration=11.708162386 podStartE2EDuration="11.708162386s" podCreationTimestamp="2026-06-03 00:19:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:19:39.694362807 +0000 UTC m=+5.782170773" watchObservedRunningTime="2026-06-03 00:19:47.708162386 +0000 UTC m=+13.795970354" Jun 03 00:19:47.760029 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.759977 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-f8hvl" podStartSLOduration=3.05208557 podStartE2EDuration="12.75996075s" podCreationTimestamp="2026-06-03 00:19:35 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.838455368 +0000 UTC m=+2.926263311" lastFinishedPulling="2026-06-03 00:19:46.546330542 +0000 UTC m=+12.634138491" observedRunningTime="2026-06-03 00:19:47.743901063 +0000 UTC m=+13.831709025" watchObservedRunningTime="2026-06-03 00:19:47.75996075 +0000 UTC m=+13.847768716" Jun 03 00:19:47.774404 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.774097 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bfhvp" podStartSLOduration=4.0687691 podStartE2EDuration="13.774081812s" podCreationTimestamp="2026-06-03 00:19:34 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.829454899 +0000 UTC m=+2.917262855" lastFinishedPulling="2026-06-03 00:19:46.53476762 +0000 UTC m=+12.622575567" observedRunningTime="2026-06-03 00:19:47.773707444 +0000 UTC m=+13.861515406" watchObservedRunningTime="2026-06-03 00:19:47.774081812 +0000 UTC m=+13.861889784" Jun 03 00:19:47.774670 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:47.774640 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9g2ws" podStartSLOduration=4.0035659 podStartE2EDuration="13.774630309s" podCreationTimestamp="2026-06-03 00:19:34 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.807447447 +0000 UTC m=+2.895255394" lastFinishedPulling="2026-06-03 00:19:46.578511854 +0000 UTC m=+12.666319803" observedRunningTime="2026-06-03 00:19:47.759951954 +0000 UTC m=+13.847759932" watchObservedRunningTime="2026-06-03 00:19:47.774630309 +0000 UTC m=+13.862438315" Jun 03 00:19:48.094945 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:48.094920 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 00:19:48.556883 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:48.556768 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T00:19:48.094943279Z","UUID":"683c95db-55dc-44fa-b3f3-554738222ad4","Handler":null,"Name":"","Endpoint":""} Jun 03 00:19:48.559418 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:48.559395 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 00:19:48.559418 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:48.559422 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 00:19:48.619147 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:48.619106 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:48.619702 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:48.619111 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:48.619702 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:48.619238 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:48.619702 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:48.619312 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:48.708659 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:48.708617 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" event={"ID":"e026d09a-f61c-4a8d-9b09-9ca40ba38592","Type":"ContainerStarted","Data":"1064801e975990f24308364fae3615b6a46e84a376dd66aae75445188d9d2151"} Jun 03 00:19:48.710412 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:48.710381 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2s8zv" event={"ID":"4d2c5118-1d5f-4974-aaaa-f6b24fcc09bc","Type":"ContainerStarted","Data":"4e4bf89cd079e7fbcbe09c646f163a5f761264a4752e542bbcd1dfb26102e275"} Jun 03 00:19:49.618774 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:49.618739 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:49.618946 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:49.618862 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:49.714560 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:49.714522 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" event={"ID":"e026d09a-f61c-4a8d-9b09-9ca40ba38592","Type":"ContainerStarted","Data":"2da2234a6bc9c92131fc20d2bb2e64323cf3d510fb7b1365bc2081778d81dbfd"} Jun 03 00:19:49.732025 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:49.731975 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2s8zv" podStartSLOduration=5.977111188 podStartE2EDuration="15.73195627s" podCreationTimestamp="2026-06-03 00:19:34 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.792968175 +0000 UTC m=+2.880776119" lastFinishedPulling="2026-06-03 00:19:46.547813244 +0000 UTC m=+12.635621201" observedRunningTime="2026-06-03 00:19:48.725441976 +0000 UTC m=+14.813249941" watchObservedRunningTime="2026-06-03 00:19:49.73195627 +0000 UTC m=+15.819764237" Jun 03 00:19:49.732518 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:49.732479 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9cs8l" podStartSLOduration=3.465485788 podStartE2EDuration="15.73246782s" podCreationTimestamp="2026-06-03 00:19:34 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.797318365 +0000 UTC m=+2.885126312" lastFinishedPulling="2026-06-03 00:19:49.06430038 +0000 UTC m=+15.152108344" observedRunningTime="2026-06-03 00:19:49.731672 +0000 UTC m=+15.819479966" watchObservedRunningTime="2026-06-03 00:19:49.73246782 +0000 UTC m=+15.820275786" Jun 03 00:19:50.618607 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:50.618565 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:50.618793 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:50.618562 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:50.618793 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:50.618699 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:50.618793 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:50.618735 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:51.619109 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:51.619072 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:51.619748 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:51.619219 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:51.759117 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:51.759085 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:51.759858 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:51.759838 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:52.229404 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:52.229365 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:52.229594 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:52.229467 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:52.229594 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.229543 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:52.229594 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.229575 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:52.229743 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.229634 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret podName:01b66153-7b87-414b-8b51-1d96488e7f8a nodeName:}" failed. No retries permitted until 2026-06-03 00:20:08.229614027 +0000 UTC m=+34.317421977 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret") pod "global-pull-secret-syncer-45fpl" (UID: "01b66153-7b87-414b-8b51-1d96488e7f8a") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:19:52.229743 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.229655 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs podName:3b116e3e-08e8-4935-8ae4-8a9b932a43b3 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:08.229644992 +0000 UTC m=+34.317452937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs") pod "network-metrics-daemon-8hgnw" (UID: "3b116e3e-08e8-4935-8ae4-8a9b932a43b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:19:52.330726 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:52.330695 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:52.330906 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.330885 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:19:52.330961 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.330912 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:19:52.330961 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.330925 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qrsgn for pod openshift-network-diagnostics/network-check-target-tmngv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:52.331042 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.330991 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn podName:03fb21a5-15bb-4eee-80d1-c368a2a50300 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:08.330970651 +0000 UTC m=+34.418778618 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qrsgn" (UniqueName: "kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn") pod "network-check-target-tmngv" (UID: "03fb21a5-15bb-4eee-80d1-c368a2a50300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:19:52.618752 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:52.618718 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:52.618941 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:52.618729 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:52.618941 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.618843 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:52.619045 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:52.618943 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:52.720671 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:52.720641 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:52.721208 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:52.721175 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bfhvp" Jun 03 00:19:53.618917 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:53.618704 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:53.619095 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:53.619041 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:54.622332 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:54.622301 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:54.622860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:54.622307 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:54.622860 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:54.622418 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:54.622860 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:54.622507 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:55.619017 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:55.618980 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:55.619225 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:55.619138 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:56.619296 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:56.619179 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:56.619825 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:56.619419 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:56.619914 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:56.619837 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:56.620013 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:56.619989 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:57.619094 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:57.619058 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:57.619344 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:57.619166 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:19:58.619483 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.619177 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:19:58.619918 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.619184 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:19:58.619918 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:58.619536 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:19:58.619918 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:58.619656 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:19:58.732540 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.732511 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:19:58.732864 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.732841 2574 generic.go:358] "Generic (PLEG): container finished" podID="212d59ce-03c1-4171-bd89-367abf0c31f5" containerID="fef97ef0134606de651eaa4ecbdecf4fd416d1e94ab47833293c20652aebc49d" exitCode=1 Jun 03 00:19:58.732965 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.732874 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"caea4ebf75769a06ac43e53f97af79f2f48d43155016949a6779518f8eb1e7f8"} Jun 03 00:19:58.732965 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.732914 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerDied","Data":"fef97ef0134606de651eaa4ecbdecf4fd416d1e94ab47833293c20652aebc49d"} Jun 03 00:19:58.732965 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.732932 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"59d17a7d2b41c1cae40159662b1d558a92b4c9129f9ee2d92298fee65273e6c5"} Jun 03 00:19:58.734247 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.734221 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2tc8k" event={"ID":"b7b24aa7-3804-471c-a6ed-f4d332b281b6","Type":"ContainerStarted","Data":"cfc8f22b3f41a667d5bc0ccf59020c981fb0fa9bc6e19a401f5ad673764730b2"} Jun 03 00:19:58.749984 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:58.749942 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-2tc8k" podStartSLOduration=3.481844524 podStartE2EDuration="24.749930854s" podCreationTimestamp="2026-06-03 00:19:34 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.821271344 +0000 UTC m=+2.909079301" lastFinishedPulling="2026-06-03 00:19:58.089357672 +0000 UTC m=+24.177165631" observedRunningTime="2026-06-03 00:19:58.749294971 +0000 UTC m=+24.837102937" watchObservedRunningTime="2026-06-03 00:19:58.749930854 +0000 UTC m=+24.837738832" Jun 03 00:19:59.619119 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:19:59.619084 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:19:59.619316 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:19:59.619239 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:20:00.618780 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:00.618744 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:00.619190 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:00.618779 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:00.619190 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:00.618854 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:20:00.619190 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:00.618990 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:20:00.739795 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:00.739769 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:20:00.740146 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:00.740126 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"5045a4b45962d63bfd805cb7df3e2e84a0b84a84ee9958bd8aadb0ea35613175"} Jun 03 00:20:00.740215 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:00.740157 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"79f5d24c425f9bab4826d83764f7f3ec7079d16ccd8b2ecc3b96499d6de22a52"} Jun 03 00:20:00.740215 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:00.740173 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"7e107e36aa4032aa34546d4e25e41c1225857ace3371aeecf322593c4e22ef23"} Jun 03 00:20:00.741570 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:00.741548 2574 generic.go:358] "Generic (PLEG): container finished" podID="5819615f-aa8e-4984-bb02-29088c6d02a1" containerID="70a33253613053231b3cb96fc5c5b7f72fbb8b03455c65e9d6f58af6a6063172" exitCode=0 Jun 03 00:20:00.741675 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:00.741579 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" event={"ID":"5819615f-aa8e-4984-bb02-29088c6d02a1","Type":"ContainerDied","Data":"70a33253613053231b3cb96fc5c5b7f72fbb8b03455c65e9d6f58af6a6063172"} Jun 03 00:20:01.619008 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:01.618990 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:01.619295 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:01.619095 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:20:01.744718 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:01.744686 2574 generic.go:358] "Generic (PLEG): container finished" podID="5819615f-aa8e-4984-bb02-29088c6d02a1" containerID="69870bc205fba84ea74563abc1e45cfc304fe40bb12304bc0272738dd1471fa2" exitCode=0 Jun 03 00:20:01.744899 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:01.744742 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" event={"ID":"5819615f-aa8e-4984-bb02-29088c6d02a1","Type":"ContainerDied","Data":"69870bc205fba84ea74563abc1e45cfc304fe40bb12304bc0272738dd1471fa2"} Jun 03 00:20:02.618526 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:02.618497 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:02.618526 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:02.618534 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:02.618679 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:02.618609 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:20:02.618768 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:02.618747 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:20:02.749274 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:02.749098 2574 generic.go:358] "Generic (PLEG): container finished" podID="5819615f-aa8e-4984-bb02-29088c6d02a1" containerID="c67ffd46b0e4ec6dc42d3ba478385a396c5f153572c0253abf71054b4dc8632c" exitCode=0 Jun 03 00:20:02.749274 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:02.749187 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" event={"ID":"5819615f-aa8e-4984-bb02-29088c6d02a1","Type":"ContainerDied","Data":"c67ffd46b0e4ec6dc42d3ba478385a396c5f153572c0253abf71054b4dc8632c"} Jun 03 00:20:02.753168 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:02.753148 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:20:02.753510 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:02.753485 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"731536a9338cfacef4929274b8a830cf811b6a02c407cf78e740fa04320f0a8f"} Jun 03 00:20:03.618267 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:03.618234 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:03.618446 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:03.618344 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:20:04.619424 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:04.619385 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:04.619860 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:04.619521 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:20:04.619860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:04.619573 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:04.619860 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:04.619721 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:20:04.759778 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:04.759757 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:20:04.760094 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:04.760072 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"5e201d935e26c7b2cafec150c06578db5c855e05871b8dba63db3bf92faa2b52"} Jun 03 00:20:04.760428 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:04.760409 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:20:04.760552 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:04.760538 2574 scope.go:117] "RemoveContainer" containerID="fef97ef0134606de651eaa4ecbdecf4fd416d1e94ab47833293c20652aebc49d" Jun 03 00:20:04.777743 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:04.777611 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:20:05.618715 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:05.618527 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:05.618896 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:05.618794 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:20:05.764409 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:05.764382 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:20:05.764942 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:05.764655 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" event={"ID":"212d59ce-03c1-4171-bd89-367abf0c31f5","Type":"ContainerStarted","Data":"eaa50e2f9d7fdb1551cf5498d1964f0d95885ea68a7cb347ddd4e3d7f2b3e6d0"} Jun 03 00:20:05.765023 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:05.765007 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:20:05.765072 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:05.765029 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:20:05.781221 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:05.781180 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:20:05.791772 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:05.791734 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" podStartSLOduration=10.512654279 podStartE2EDuration="31.791722312s" podCreationTimestamp="2026-06-03 00:19:34 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.844630814 +0000 UTC m=+2.932438771" lastFinishedPulling="2026-06-03 00:19:58.123698848 +0000 UTC m=+24.211506804" observedRunningTime="2026-06-03 00:20:05.791328825 +0000 UTC m=+31.879136791" watchObservedRunningTime="2026-06-03 00:20:05.791722312 +0000 UTC m=+31.879530276" Jun 03 00:20:06.618549 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:06.618514 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:06.618714 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:06.618514 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:06.618714 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:06.618635 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:20:06.618714 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:06.618696 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:20:06.673503 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:06.673457 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45fpl"] Jun 03 00:20:06.675928 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:06.675900 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hgnw"] Jun 03 00:20:06.676068 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:06.676019 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:06.676127 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:06.676105 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:20:06.690728 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:06.690705 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tmngv"] Jun 03 00:20:06.766046 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:06.766014 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:06.766462 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:06.766014 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:06.766462 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:06.766126 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:20:06.766462 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:06.766182 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:20:08.248818 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:08.248781 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:08.249313 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:08.248829 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:08.249313 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.248935 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:20:08.249313 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.248987 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs podName:3b116e3e-08e8-4935-8ae4-8a9b932a43b3 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:40.248974894 +0000 UTC m=+66.336782837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs") pod "network-metrics-daemon-8hgnw" (UID: "3b116e3e-08e8-4935-8ae4-8a9b932a43b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 00:20:08.249313 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.248935 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 00:20:08.249313 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.249069 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret podName:01b66153-7b87-414b-8b51-1d96488e7f8a nodeName:}" failed. No retries permitted until 2026-06-03 00:20:40.249056622 +0000 UTC m=+66.336864579 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret") pod "global-pull-secret-syncer-45fpl" (UID: "01b66153-7b87-414b-8b51-1d96488e7f8a") : object "kube-system"/"original-pull-secret" not registered Jun 03 00:20:08.350145 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:08.350104 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:08.350315 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.350254 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 00:20:08.350315 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.350273 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 00:20:08.350315 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.350285 2574 projected.go:194] Error preparing data for projected volume kube-api-access-qrsgn for pod openshift-network-diagnostics/network-check-target-tmngv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:20:08.350431 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.350336 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn podName:03fb21a5-15bb-4eee-80d1-c368a2a50300 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:40.350322053 +0000 UTC m=+66.438129995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qrsgn" (UniqueName: "kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn") pod "network-check-target-tmngv" (UID: "03fb21a5-15bb-4eee-80d1-c368a2a50300") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 00:20:08.618587 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:08.618548 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:08.618770 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:08.618639 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:08.618770 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:08.618660 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:08.618770 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.618736 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:20:08.618940 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.618831 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:20:08.618940 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:08.618928 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:20:10.618742 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:10.618704 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:10.619181 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:10.618704 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:10.619181 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:10.618836 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:20:10.619181 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:10.618714 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:10.619181 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:10.618912 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:20:10.619181 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:10.618968 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:20:12.622422 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.622391 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:12.622820 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.622391 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:12.622820 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.622503 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:12.622820 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:12.622520 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-45fpl" podUID="01b66153-7b87-414b-8b51-1d96488e7f8a" Jun 03 00:20:12.622820 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:12.622596 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8hgnw" podUID="3b116e3e-08e8-4935-8ae4-8a9b932a43b3" Jun 03 00:20:12.622820 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:12.622663 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tmngv" podUID="03fb21a5-15bb-4eee-80d1-c368a2a50300" Jun 03 00:20:12.755852 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.755778 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-183.ec2.internal" event="NodeReady" Jun 03 00:20:12.756008 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.755931 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 00:20:12.795551 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.795514 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xdhhv"] Jun 03 00:20:12.819803 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.819767 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rk7hj"] Jun 03 00:20:12.819803 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.819788 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:12.822305 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.822271 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 00:20:12.822435 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.822337 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5c68x\"" Jun 03 00:20:12.822633 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.822611 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 00:20:12.833810 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.833792 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xdhhv"] Jun 03 00:20:12.833810 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.833814 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rk7hj"] Jun 03 00:20:12.833968 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.833903 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:12.836173 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.836155 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 00:20:12.836331 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.836154 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 00:20:12.836331 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.836325 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 00:20:12.836478 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.836463 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8cxnz\"" Jun 03 00:20:12.985112 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.985072 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv2n2\" (UniqueName: \"kubernetes.io/projected/eefd36b7-077a-4ffb-a886-28acaba8d024-kube-api-access-kv2n2\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:12.985318 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.985143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:12.985318 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.985238 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eefd36b7-077a-4ffb-a886-28acaba8d024-tmp-dir\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:12.985318 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.985256 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:12.985318 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.985280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eefd36b7-077a-4ffb-a886-28acaba8d024-config-volume\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:12.985318 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:12.985302 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghcch\" (UniqueName: \"kubernetes.io/projected/ffb74965-df28-4cbf-8cdf-21ef1f693101-kube-api-access-ghcch\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:13.086485 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.086363 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kv2n2\" (UniqueName: \"kubernetes.io/projected/eefd36b7-077a-4ffb-a886-28acaba8d024-kube-api-access-kv2n2\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:13.086485 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.086465 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:13.086703 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.086507 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eefd36b7-077a-4ffb-a886-28acaba8d024-tmp-dir\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:13.086703 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.086527 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:13.086703 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.086559 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eefd36b7-077a-4ffb-a886-28acaba8d024-config-volume\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:13.086703 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.086586 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghcch\" (UniqueName: \"kubernetes.io/projected/ffb74965-df28-4cbf-8cdf-21ef1f693101-kube-api-access-ghcch\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:13.086703 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:13.086623 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:13.086703 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:13.086700 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls podName:eefd36b7-077a-4ffb-a886-28acaba8d024 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:13.5866759 +0000 UTC m=+39.674483857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls") pod "dns-default-xdhhv" (UID: "eefd36b7-077a-4ffb-a886-28acaba8d024") : secret "dns-default-metrics-tls" not found Jun 03 00:20:13.086989 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:13.086878 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:13.086989 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:13.086914 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert podName:ffb74965-df28-4cbf-8cdf-21ef1f693101 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:13.586902213 +0000 UTC m=+39.674710161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert") pod "ingress-canary-rk7hj" (UID: "ffb74965-df28-4cbf-8cdf-21ef1f693101") : secret "canary-serving-cert" not found Jun 03 00:20:13.087386 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.087355 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eefd36b7-077a-4ffb-a886-28acaba8d024-tmp-dir\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:13.087658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.087630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eefd36b7-077a-4ffb-a886-28acaba8d024-config-volume\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:13.097295 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.097263 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv2n2\" (UniqueName: \"kubernetes.io/projected/eefd36b7-077a-4ffb-a886-28acaba8d024-kube-api-access-kv2n2\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:13.097492 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.097469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghcch\" (UniqueName: \"kubernetes.io/projected/ffb74965-df28-4cbf-8cdf-21ef1f693101-kube-api-access-ghcch\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:13.590056 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.590029 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:13.590158 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.590073 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:13.590219 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:13.590168 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:13.590261 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:13.590229 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert podName:ffb74965-df28-4cbf-8cdf-21ef1f693101 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:14.590210944 +0000 UTC m=+40.678018887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert") pod "ingress-canary-rk7hj" (UID: "ffb74965-df28-4cbf-8cdf-21ef1f693101") : secret "canary-serving-cert" not found Jun 03 00:20:13.590261 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:13.590241 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:13.590337 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:13.590290 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls podName:eefd36b7-077a-4ffb-a886-28acaba8d024 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:14.590274781 +0000 UTC m=+40.678082740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls") pod "dns-default-xdhhv" (UID: "eefd36b7-077a-4ffb-a886-28acaba8d024") : secret "dns-default-metrics-tls" not found Jun 03 00:20:13.780369 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.780339 2574 generic.go:358] "Generic (PLEG): container finished" podID="5819615f-aa8e-4984-bb02-29088c6d02a1" containerID="cf59305b966a9d8f602c3841295f1f64e5d1d924d56f3c57967b3f16bb2900ae" exitCode=0 Jun 03 00:20:13.780857 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:13.780395 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" event={"ID":"5819615f-aa8e-4984-bb02-29088c6d02a1","Type":"ContainerDied","Data":"cf59305b966a9d8f602c3841295f1f64e5d1d924d56f3c57967b3f16bb2900ae"} Jun 03 00:20:14.597653 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.597614 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:14.597653 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.597657 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:14.597898 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:14.597769 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:14.597898 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:14.597793 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:14.597898 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:14.597837 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls podName:eefd36b7-077a-4ffb-a886-28acaba8d024 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:16.5978225 +0000 UTC m=+42.685630453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls") pod "dns-default-xdhhv" (UID: "eefd36b7-077a-4ffb-a886-28acaba8d024") : secret "dns-default-metrics-tls" not found Jun 03 00:20:14.597898 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:14.597853 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert podName:ffb74965-df28-4cbf-8cdf-21ef1f693101 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:16.597848134 +0000 UTC m=+42.685656077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert") pod "ingress-canary-rk7hj" (UID: "ffb74965-df28-4cbf-8cdf-21ef1f693101") : secret "canary-serving-cert" not found Jun 03 00:20:14.619845 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.619818 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:14.620015 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.619994 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:14.620103 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.620090 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:14.622469 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.622451 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 00:20:14.623598 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.623574 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-88bpn\"" Jun 03 00:20:14.623598 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.623591 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 00:20:14.623749 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.623598 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nw924\"" Jun 03 00:20:14.623749 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.623574 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 00:20:14.623749 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.623591 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 00:20:14.784403 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.784372 2574 generic.go:358] "Generic (PLEG): container finished" podID="5819615f-aa8e-4984-bb02-29088c6d02a1" containerID="1a1431aab39a732d91e14cffb322757d9ac88961e07302dbf804efe5c0365bee" exitCode=0 Jun 03 00:20:14.784848 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:14.784438 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" event={"ID":"5819615f-aa8e-4984-bb02-29088c6d02a1","Type":"ContainerDied","Data":"1a1431aab39a732d91e14cffb322757d9ac88961e07302dbf804efe5c0365bee"} Jun 03 00:20:15.789156 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:15.789121 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" event={"ID":"5819615f-aa8e-4984-bb02-29088c6d02a1","Type":"ContainerStarted","Data":"21c60f16ba192ba545e8c903f8b6e6f7f38eb888ac2df74b2a164f09e33b96df"} Jun 03 00:20:15.809609 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:15.809566 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wqmj8" podStartSLOduration=5.153862324 podStartE2EDuration="41.809552512s" podCreationTimestamp="2026-06-03 00:19:34 +0000 UTC" firstStartedPulling="2026-06-03 00:19:36.81436851 +0000 UTC m=+2.902176454" lastFinishedPulling="2026-06-03 00:20:13.470058684 +0000 UTC m=+39.557866642" observedRunningTime="2026-06-03 00:20:15.80811924 +0000 UTC m=+41.895927206" watchObservedRunningTime="2026-06-03 00:20:15.809552512 +0000 UTC m=+41.897360476" Jun 03 00:20:16.611280 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:16.611246 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:16.611438 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:16.611298 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:16.611438 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:16.611409 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:16.611507 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:16.611467 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert podName:ffb74965-df28-4cbf-8cdf-21ef1f693101 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:20.61145381 +0000 UTC m=+46.699261753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert") pod "ingress-canary-rk7hj" (UID: "ffb74965-df28-4cbf-8cdf-21ef1f693101") : secret "canary-serving-cert" not found Jun 03 00:20:16.611547 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:16.611409 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:16.611579 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:16.611550 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls podName:eefd36b7-077a-4ffb-a886-28acaba8d024 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:20.611538112 +0000 UTC m=+46.699346065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls") pod "dns-default-xdhhv" (UID: "eefd36b7-077a-4ffb-a886-28acaba8d024") : secret "dns-default-metrics-tls" not found Jun 03 00:20:20.636568 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:20.636535 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:20.636943 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:20.636576 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:20.636943 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:20.636676 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:20.636943 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:20.636684 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:20.636943 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:20.636725 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert podName:ffb74965-df28-4cbf-8cdf-21ef1f693101 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:28.636711229 +0000 UTC m=+54.724519172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert") pod "ingress-canary-rk7hj" (UID: "ffb74965-df28-4cbf-8cdf-21ef1f693101") : secret "canary-serving-cert" not found Jun 03 00:20:20.636943 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:20.636744 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls podName:eefd36b7-077a-4ffb-a886-28acaba8d024 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:28.636731855 +0000 UTC m=+54.724539799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls") pod "dns-default-xdhhv" (UID: "eefd36b7-077a-4ffb-a886-28acaba8d024") : secret "dns-default-metrics-tls" not found Jun 03 00:20:28.693161 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:28.692970 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:28.693730 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:28.693175 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:28.693730 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:28.693116 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:28.693730 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:28.693276 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls podName:eefd36b7-077a-4ffb-a886-28acaba8d024 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:44.693259537 +0000 UTC m=+70.781067480 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls") pod "dns-default-xdhhv" (UID: "eefd36b7-077a-4ffb-a886-28acaba8d024") : secret "dns-default-metrics-tls" not found Jun 03 00:20:28.693730 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:28.693290 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:28.693730 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:28.693332 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert podName:ffb74965-df28-4cbf-8cdf-21ef1f693101 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:44.693320997 +0000 UTC m=+70.781128941 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert") pod "ingress-canary-rk7hj" (UID: "ffb74965-df28-4cbf-8cdf-21ef1f693101") : secret "canary-serving-cert" not found Jun 03 00:20:37.777740 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:37.777711 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-f8zgw" Jun 03 00:20:40.268631 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.268582 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:40.268631 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.268633 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:20:40.271335 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.271315 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 00:20:40.271387 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.271340 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 00:20:40.279330 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:40.279314 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 00:20:40.279386 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:40.279377 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs podName:3b116e3e-08e8-4935-8ae4-8a9b932a43b3 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:44.279363012 +0000 UTC m=+130.367170961 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs") pod "network-metrics-daemon-8hgnw" (UID: "3b116e3e-08e8-4935-8ae4-8a9b932a43b3") : secret "metrics-daemon-secret" not found Jun 03 00:20:40.282023 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.281994 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/01b66153-7b87-414b-8b51-1d96488e7f8a-original-pull-secret\") pod \"global-pull-secret-syncer-45fpl\" (UID: \"01b66153-7b87-414b-8b51-1d96488e7f8a\") " pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:40.369709 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.369668 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:40.372370 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.372353 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 00:20:40.383108 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.383090 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 00:20:40.393608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.393584 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrsgn\" (UniqueName: \"kubernetes.io/projected/03fb21a5-15bb-4eee-80d1-c368a2a50300-kube-api-access-qrsgn\") pod \"network-check-target-tmngv\" (UID: \"03fb21a5-15bb-4eee-80d1-c368a2a50300\") " pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:40.394347 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.394326 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s"] Jun 03 00:20:40.397687 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.397670 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh"] Jun 03 00:20:40.397823 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.397807 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.399486 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.399469 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:40.400499 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.400477 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8s54q\"" Jun 03 00:20:40.401367 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.401347 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 00:20:40.402655 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.402639 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 00:20:40.402909 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.402883 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 03 00:20:40.404563 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.403829 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 00:20:40.404563 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.404050 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:20:40.404563 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.404208 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 03 00:20:40.404563 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.404280 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh"] Jun 03 00:20:40.404563 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.404451 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bzfx8\"" Jun 03 00:20:40.404563 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.404477 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 00:20:40.407426 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.407406 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s"] Jun 03 00:20:40.437467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.437444 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nw924\"" Jun 03 00:20:40.439375 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.439361 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-45fpl" Jun 03 00:20:40.445580 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.445561 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:40.470710 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.470674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgccw\" (UniqueName: \"kubernetes.io/projected/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-kube-api-access-sgccw\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:40.470840 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.470792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:40.470887 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.470837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6nhs\" (UniqueName: \"kubernetes.io/projected/0b1238f1-e829-499b-aa6d-bf5dbfcace10-kube-api-access-q6nhs\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.470887 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.470861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b1238f1-e829-499b-aa6d-bf5dbfcace10-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.470959 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.470888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.571661 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.571629 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sgccw\" (UniqueName: \"kubernetes.io/projected/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-kube-api-access-sgccw\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:40.572307 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.571935 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:40.572307 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.571979 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q6nhs\" (UniqueName: \"kubernetes.io/projected/0b1238f1-e829-499b-aa6d-bf5dbfcace10-kube-api-access-q6nhs\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.572307 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.572012 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b1238f1-e829-499b-aa6d-bf5dbfcace10-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.572307 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.572052 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.572307 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:40.572102 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:20:40.572307 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:40.572158 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:40.572307 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:40.572162 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls podName:c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:41.072141591 +0000 UTC m=+67.159949548 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d9dmh" (UID: "c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191") : secret "samples-operator-tls" not found Jun 03 00:20:40.572710 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:40.572334 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls podName:0b1238f1-e829-499b-aa6d-bf5dbfcace10 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:41.072311078 +0000 UTC m=+67.160119037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-cbb5s" (UID: "0b1238f1-e829-499b-aa6d-bf5dbfcace10") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:40.573144 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.573116 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0b1238f1-e829-499b-aa6d-bf5dbfcace10-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.580315 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.580290 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6nhs\" (UniqueName: \"kubernetes.io/projected/0b1238f1-e829-499b-aa6d-bf5dbfcace10-kube-api-access-q6nhs\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:40.580446 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.580323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgccw\" (UniqueName: \"kubernetes.io/projected/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-kube-api-access-sgccw\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:40.592185 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.592162 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-45fpl"] Jun 03 00:20:40.595471 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:20:40.595448 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01b66153_7b87_414b_8b51_1d96488e7f8a.slice/crio-43461ffa74c8f6ff8ce5eab681ed16c3e282e2cec24b877370ad4bcedeadb03c WatchSource:0}: Error finding container 43461ffa74c8f6ff8ce5eab681ed16c3e282e2cec24b877370ad4bcedeadb03c: Status 404 returned error can't find the container with id 43461ffa74c8f6ff8ce5eab681ed16c3e282e2cec24b877370ad4bcedeadb03c Jun 03 00:20:40.599065 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.599045 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tmngv"] Jun 03 00:20:40.602228 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:20:40.602188 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03fb21a5_15bb_4eee_80d1_c368a2a50300.slice/crio-e160b901ad1d3eb250bd42d0500edf868bc6f0bf6b90082ce94a8a828656814b WatchSource:0}: Error finding container e160b901ad1d3eb250bd42d0500edf868bc6f0bf6b90082ce94a8a828656814b: Status 404 returned error can't find the container with id e160b901ad1d3eb250bd42d0500edf868bc6f0bf6b90082ce94a8a828656814b Jun 03 00:20:40.836629 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.836540 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tmngv" event={"ID":"03fb21a5-15bb-4eee-80d1-c368a2a50300","Type":"ContainerStarted","Data":"e160b901ad1d3eb250bd42d0500edf868bc6f0bf6b90082ce94a8a828656814b"} Jun 03 00:20:40.837394 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:40.837375 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45fpl" event={"ID":"01b66153-7b87-414b-8b51-1d96488e7f8a","Type":"ContainerStarted","Data":"43461ffa74c8f6ff8ce5eab681ed16c3e282e2cec24b877370ad4bcedeadb03c"} Jun 03 00:20:41.075469 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:41.075433 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:41.075643 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:41.075587 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:41.075643 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:41.075613 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:41.075734 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:41.075651 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls podName:0b1238f1-e829-499b-aa6d-bf5dbfcace10 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:42.075635049 +0000 UTC m=+68.163442997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-cbb5s" (UID: "0b1238f1-e829-499b-aa6d-bf5dbfcace10") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:41.075734 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:41.075693 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:20:41.075804 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:41.075751 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls podName:c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:42.075738529 +0000 UTC m=+68.163546472 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d9dmh" (UID: "c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191") : secret "samples-operator-tls" not found Jun 03 00:20:42.084600 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:42.084068 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:42.084600 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:42.084501 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:42.084600 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:42.084606 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls podName:0b1238f1-e829-499b-aa6d-bf5dbfcace10 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:44.084574745 +0000 UTC m=+70.172382708 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-cbb5s" (UID: "0b1238f1-e829-499b-aa6d-bf5dbfcace10") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:42.085161 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:42.084676 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:42.085161 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:42.084823 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:20:42.085161 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:42.084872 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls podName:c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:44.084858412 +0000 UTC m=+70.172666369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d9dmh" (UID: "c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191") : secret "samples-operator-tls" not found Jun 03 00:20:43.415122 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.415089 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b5bc4bfc6-jbgjh"] Jun 03 00:20:43.417618 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.417598 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.419929 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.419905 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 03 00:20:43.420069 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.420051 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 03 00:20:43.420139 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.420034 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vhztx\"" Jun 03 00:20:43.420367 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.420351 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 03 00:20:43.424685 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.424580 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 03 00:20:43.427555 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.427533 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5bc4bfc6-jbgjh"] Jun 03 00:20:43.497523 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.497486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.497523 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.497535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123bf50e-24ce-443e-89ff-e27607685bb2-ca-trust-extracted\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.497739 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.497561 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-trusted-ca\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.497739 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.497646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-installation-pull-secrets\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.497739 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.497685 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-registry-certificates\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.497858 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.497749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-image-registry-private-configuration\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.497858 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.497805 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xch6\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-kube-api-access-9xch6\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.497858 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.497837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-bound-sa-token\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.598983 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.598947 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-image-registry-private-configuration\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.599150 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599015 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9xch6\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-kube-api-access-9xch6\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.599150 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599040 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-bound-sa-token\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.599150 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599095 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.599150 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599126 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123bf50e-24ce-443e-89ff-e27607685bb2-ca-trust-extracted\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.599382 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599152 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-trusted-ca\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.599382 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599176 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-installation-pull-secrets\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.599382 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599221 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-registry-certificates\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.599382 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:43.599373 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:20:43.599585 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:43.599394 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5bc4bfc6-jbgjh: secret "image-registry-tls" not found Jun 03 00:20:43.599585 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:43.599467 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls podName:123bf50e-24ce-443e-89ff-e27607685bb2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:44.099445741 +0000 UTC m=+70.187253684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls") pod "image-registry-b5bc4bfc6-jbgjh" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2") : secret "image-registry-tls" not found Jun 03 00:20:43.599661 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123bf50e-24ce-443e-89ff-e27607685bb2-ca-trust-extracted\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.600007 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.599981 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-registry-certificates\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.600189 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.600169 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-trusted-ca\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.601758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.601733 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-image-registry-private-configuration\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.601863 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.601767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-installation-pull-secrets\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.610021 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.609996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-bound-sa-token\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:43.610346 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:43.610329 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xch6\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-kube-api-access-9xch6\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:44.103724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:44.103677 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:44.103909 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:44.103734 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:44.103909 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:44.103788 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:44.104011 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.103944 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:44.104065 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.104057 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls podName:0b1238f1-e829-499b-aa6d-bf5dbfcace10 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:48.10403836 +0000 UTC m=+74.191846307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-cbb5s" (UID: "0b1238f1-e829-499b-aa6d-bf5dbfcace10") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:44.104138 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.104122 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:20:44.104186 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.104163 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls podName:c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:48.1041528 +0000 UTC m=+74.191960745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d9dmh" (UID: "c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191") : secret "samples-operator-tls" not found Jun 03 00:20:44.104303 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.104289 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:20:44.104360 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.104306 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5bc4bfc6-jbgjh: secret "image-registry-tls" not found Jun 03 00:20:44.104360 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.104341 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls podName:123bf50e-24ce-443e-89ff-e27607685bb2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:45.10433045 +0000 UTC m=+71.192138396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls") pod "image-registry-b5bc4bfc6-jbgjh" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2") : secret "image-registry-tls" not found Jun 03 00:20:44.710545 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:44.710510 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:20:44.710902 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:44.710636 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:20:44.710902 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.710655 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 03 00:20:44.710902 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.710713 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert podName:ffb74965-df28-4cbf-8cdf-21ef1f693101 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:16.710693662 +0000 UTC m=+102.798501622 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert") pod "ingress-canary-rk7hj" (UID: "ffb74965-df28-4cbf-8cdf-21ef1f693101") : secret "canary-serving-cert" not found Jun 03 00:20:44.710902 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.710723 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 00:20:44.710902 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:44.710768 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls podName:eefd36b7-077a-4ffb-a886-28acaba8d024 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:16.710757477 +0000 UTC m=+102.798565433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls") pod "dns-default-xdhhv" (UID: "eefd36b7-077a-4ffb-a886-28acaba8d024") : secret "dns-default-metrics-tls" not found Jun 03 00:20:44.845743 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:44.845715 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tmngv" event={"ID":"03fb21a5-15bb-4eee-80d1-c368a2a50300","Type":"ContainerStarted","Data":"13224dc5df1318b8792e80245c62b506650c453b43bddcf5a075efbdb89bd0a2"} Jun 03 00:20:44.845916 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:44.845880 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:20:44.859352 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:44.859312 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tmngv" podStartSLOduration=66.324285215 podStartE2EDuration="1m9.859298651s" podCreationTimestamp="2026-06-03 00:19:35 +0000 UTC" firstStartedPulling="2026-06-03 00:20:40.6044657 +0000 UTC m=+66.692273643" lastFinishedPulling="2026-06-03 00:20:44.13947912 +0000 UTC m=+70.227287079" observedRunningTime="2026-06-03 00:20:44.859165118 +0000 UTC m=+70.946973084" watchObservedRunningTime="2026-06-03 00:20:44.859298651 +0000 UTC m=+70.947106615" Jun 03 00:20:45.112821 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:45.112778 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:45.112987 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:45.112916 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:20:45.112987 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:45.112929 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5bc4bfc6-jbgjh: secret "image-registry-tls" not found Jun 03 00:20:45.112987 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:45.112983 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls podName:123bf50e-24ce-443e-89ff-e27607685bb2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:47.11296815 +0000 UTC m=+73.200776093 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls") pod "image-registry-b5bc4bfc6-jbgjh" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2") : secret "image-registry-tls" not found Jun 03 00:20:46.618651 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:46.618626 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8hvl_3c455288-52d8-48a5-8839-0bc3c874c168/dns-node-resolver/0.log" Jun 03 00:20:46.850234 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:46.850185 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-45fpl" event={"ID":"01b66153-7b87-414b-8b51-1d96488e7f8a","Type":"ContainerStarted","Data":"346a6d48c6177014f8eb86caf13dfae20656189c56c83bdbe47b91512894a190"} Jun 03 00:20:47.130359 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:47.130323 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:47.130541 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:47.130475 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:20:47.130541 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:47.130496 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5bc4bfc6-jbgjh: secret "image-registry-tls" not found Jun 03 00:20:47.130611 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:47.130548 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls podName:123bf50e-24ce-443e-89ff-e27607685bb2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:51.130533629 +0000 UTC m=+77.218341573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls") pod "image-registry-b5bc4bfc6-jbgjh" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2") : secret "image-registry-tls" not found Jun 03 00:20:47.418714 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:47.418640 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ndzr2_754c1b71-4865-43d6-ab7d-982df313977c/node-ca/0.log" Jun 03 00:20:48.136682 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.136649 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:48.137067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.136727 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:48.137067 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:48.136797 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:48.137067 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:48.136824 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:20:48.137067 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:48.136873 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls podName:c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:56.136859806 +0000 UTC m=+82.224667749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d9dmh" (UID: "c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191") : secret "samples-operator-tls" not found Jun 03 00:20:48.137067 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:48.136886 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls podName:0b1238f1-e829-499b-aa6d-bf5dbfcace10 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:56.136880466 +0000 UTC m=+82.224688408 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-cbb5s" (UID: "0b1238f1-e829-499b-aa6d-bf5dbfcace10") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:48.373799 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.373749 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-45fpl" podStartSLOduration=67.319289331 podStartE2EDuration="1m13.37373399s" podCreationTimestamp="2026-06-03 00:19:35 +0000 UTC" firstStartedPulling="2026-06-03 00:20:40.59710632 +0000 UTC m=+66.684914264" lastFinishedPulling="2026-06-03 00:20:46.65155098 +0000 UTC m=+72.739358923" observedRunningTime="2026-06-03 00:20:46.862895746 +0000 UTC m=+72.950703711" watchObservedRunningTime="2026-06-03 00:20:48.37373399 +0000 UTC m=+74.461541954" Jun 03 00:20:48.374248 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.374232 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm"] Jun 03 00:20:48.389172 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.389105 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm"] Jun 03 00:20:48.389311 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.389241 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.391778 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.391680 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 00:20:48.391778 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.391757 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 00:20:48.391986 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.391691 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 00:20:48.393434 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.393409 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-j2wr8\"" Jun 03 00:20:48.393661 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.393644 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:20:48.439769 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.439730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m9w2\" (UniqueName: \"kubernetes.io/projected/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-kube-api-access-7m9w2\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.439769 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.439772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-serving-cert\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.439969 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.439794 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-config\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.540180 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.540137 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7m9w2\" (UniqueName: \"kubernetes.io/projected/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-kube-api-access-7m9w2\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.540180 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.540179 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-serving-cert\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.540393 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.540219 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-config\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.540711 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.540693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-config\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.542359 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.542338 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-serving-cert\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.547599 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.547575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m9w2\" (UniqueName: \"kubernetes.io/projected/2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc-kube-api-access-7m9w2\") pod \"service-ca-operator-69877444c-8c8jm\" (UID: \"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc\") " pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.701961 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.701861 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" Jun 03 00:20:48.820068 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.820037 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm"] Jun 03 00:20:48.823158 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:20:48.823128 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2acdf7b9_ed15_4af2_bc1e_e71a665ab4fc.slice/crio-a84f248bad9064a352a02ddc2f64fa6db35b078ca967092d6cc664b2db7cbf7f WatchSource:0}: Error finding container a84f248bad9064a352a02ddc2f64fa6db35b078ca967092d6cc664b2db7cbf7f: Status 404 returned error can't find the container with id a84f248bad9064a352a02ddc2f64fa6db35b078ca967092d6cc664b2db7cbf7f Jun 03 00:20:48.854003 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:48.853976 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" event={"ID":"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc","Type":"ContainerStarted","Data":"a84f248bad9064a352a02ddc2f64fa6db35b078ca967092d6cc664b2db7cbf7f"} Jun 03 00:20:51.160835 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:51.160800 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:51.161223 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:51.160944 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:20:51.161223 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:51.160963 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5bc4bfc6-jbgjh: secret "image-registry-tls" not found Jun 03 00:20:51.161223 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:51.161015 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls podName:123bf50e-24ce-443e-89ff-e27607685bb2 nodeName:}" failed. No retries permitted until 2026-06-03 00:20:59.161000054 +0000 UTC m=+85.248808001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls") pod "image-registry-b5bc4bfc6-jbgjh" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2") : secret "image-registry-tls" not found Jun 03 00:20:52.863824 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:52.863786 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" event={"ID":"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc","Type":"ContainerStarted","Data":"5710074c0532f4d571928d79062d174ac87d1f1b4dfa54087419366081f27ae9"} Jun 03 00:20:52.878448 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:52.878401 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" podStartSLOduration=1.6842956980000001 podStartE2EDuration="4.878389285s" podCreationTimestamp="2026-06-03 00:20:48 +0000 UTC" firstStartedPulling="2026-06-03 00:20:48.825260455 +0000 UTC m=+74.913068399" lastFinishedPulling="2026-06-03 00:20:52.019354027 +0000 UTC m=+78.107161986" observedRunningTime="2026-06-03 00:20:52.877719893 +0000 UTC m=+78.965527858" watchObservedRunningTime="2026-06-03 00:20:52.878389285 +0000 UTC m=+78.966197286" Jun 03 00:20:55.813447 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.813413 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wdspk"] Jun 03 00:20:55.815153 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.815136 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:55.817338 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.817316 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 00:20:55.818543 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.818524 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 00:20:55.818654 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.818544 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8d69b\"" Jun 03 00:20:55.818654 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.818557 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 00:20:55.818654 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.818573 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 00:20:55.823380 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.823362 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wdspk"] Jun 03 00:20:55.898790 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.898764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/027c1d11-6ef9-4378-a249-13b4712063dc-signing-key\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:55.898916 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.898793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwbxs\" (UniqueName: \"kubernetes.io/projected/027c1d11-6ef9-4378-a249-13b4712063dc-kube-api-access-hwbxs\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:55.898916 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:55.898837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/027c1d11-6ef9-4378-a249-13b4712063dc-signing-cabundle\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:56.000184 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.000158 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/027c1d11-6ef9-4378-a249-13b4712063dc-signing-key\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:56.000322 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.000187 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwbxs\" (UniqueName: \"kubernetes.io/projected/027c1d11-6ef9-4378-a249-13b4712063dc-kube-api-access-hwbxs\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:56.000322 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.000272 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/027c1d11-6ef9-4378-a249-13b4712063dc-signing-cabundle\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:56.000943 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.000926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/027c1d11-6ef9-4378-a249-13b4712063dc-signing-cabundle\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:56.002441 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.002422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/027c1d11-6ef9-4378-a249-13b4712063dc-signing-key\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:56.008678 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.008657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwbxs\" (UniqueName: \"kubernetes.io/projected/027c1d11-6ef9-4378-a249-13b4712063dc-kube-api-access-hwbxs\") pod \"service-ca-685df94d57-wdspk\" (UID: \"027c1d11-6ef9-4378-a249-13b4712063dc\") " pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:56.124467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.124436 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-wdspk" Jun 03 00:20:56.202724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.202690 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:20:56.202877 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.202825 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:20:56.202935 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:56.202831 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:56.202984 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:56.202885 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 00:20:56.202984 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:56.202961 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls podName:0b1238f1-e829-499b-aa6d-bf5dbfcace10 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:12.20294084 +0000 UTC m=+98.290748799 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-cbb5s" (UID: "0b1238f1-e829-499b-aa6d-bf5dbfcace10") : secret "cluster-monitoring-operator-tls" not found Jun 03 00:20:56.203100 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:56.202993 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls podName:c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:12.202979368 +0000 UTC m=+98.290787315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-d9dmh" (UID: "c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191") : secret "samples-operator-tls" not found Jun 03 00:20:56.239882 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.239852 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-wdspk"] Jun 03 00:20:56.242982 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:20:56.242957 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027c1d11_6ef9_4378_a249_13b4712063dc.slice/crio-c9589da3f6849ec02ff691b970742b2ebe23b90072dfda0d695e591090d11f9f WatchSource:0}: Error finding container c9589da3f6849ec02ff691b970742b2ebe23b90072dfda0d695e591090d11f9f: Status 404 returned error can't find the container with id c9589da3f6849ec02ff691b970742b2ebe23b90072dfda0d695e591090d11f9f Jun 03 00:20:56.872808 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.872769 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-wdspk" event={"ID":"027c1d11-6ef9-4378-a249-13b4712063dc","Type":"ContainerStarted","Data":"69de25c5ac5927bfd0786b005e0b25e6aa00d3de74122c329e175d4dfadc8ace"} Jun 03 00:20:56.872808 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.872806 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-wdspk" event={"ID":"027c1d11-6ef9-4378-a249-13b4712063dc","Type":"ContainerStarted","Data":"c9589da3f6849ec02ff691b970742b2ebe23b90072dfda0d695e591090d11f9f"} Jun 03 00:20:56.888144 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:56.888099 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-wdspk" podStartSLOduration=1.888084949 podStartE2EDuration="1.888084949s" podCreationTimestamp="2026-06-03 00:20:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:20:56.887160334 +0000 UTC m=+82.974968299" watchObservedRunningTime="2026-06-03 00:20:56.888084949 +0000 UTC m=+82.975892916" Jun 03 00:20:59.225345 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:20:59.225300 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:20:59.225838 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:59.225478 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 03 00:20:59.225838 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:59.225503 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b5bc4bfc6-jbgjh: secret "image-registry-tls" not found Jun 03 00:20:59.225838 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:20:59.225575 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls podName:123bf50e-24ce-443e-89ff-e27607685bb2 nodeName:}" failed. No retries permitted until 2026-06-03 00:21:15.225554263 +0000 UTC m=+101.313362213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls") pod "image-registry-b5bc4bfc6-jbgjh" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2") : secret "image-registry-tls" not found Jun 03 00:21:12.231301 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.231247 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:21:12.231746 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.231345 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:21:12.233755 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.233716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-d9dmh\" (UID: \"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:21:12.233755 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.233716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b1238f1-e829-499b-aa6d-bf5dbfcace10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-cbb5s\" (UID: \"0b1238f1-e829-499b-aa6d-bf5dbfcace10\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:21:12.509827 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.509730 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" Jun 03 00:21:12.515546 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.515516 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" Jun 03 00:21:12.637362 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.637331 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s"] Jun 03 00:21:12.640823 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:12.640794 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1238f1_e829_499b_aa6d_bf5dbfcace10.slice/crio-12da62d45b078b558ee9a5e8cfcb9cf536193eb5e3b3e5fc928ccec25a623a4a WatchSource:0}: Error finding container 12da62d45b078b558ee9a5e8cfcb9cf536193eb5e3b3e5fc928ccec25a623a4a: Status 404 returned error can't find the container with id 12da62d45b078b558ee9a5e8cfcb9cf536193eb5e3b3e5fc928ccec25a623a4a Jun 03 00:21:12.650853 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.650829 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh"] Jun 03 00:21:12.905492 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.905457 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" event={"ID":"0b1238f1-e829-499b-aa6d-bf5dbfcace10","Type":"ContainerStarted","Data":"12da62d45b078b558ee9a5e8cfcb9cf536193eb5e3b3e5fc928ccec25a623a4a"} Jun 03 00:21:12.906357 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:12.906331 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" event={"ID":"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191","Type":"ContainerStarted","Data":"fc19120e2a3f9d16551aecd07a8aa5ddf34d5b93a0a60fdd7562f01600d0c5ad"} Jun 03 00:21:15.258146 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:15.258059 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:21:15.260443 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:15.260422 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"image-registry-b5bc4bfc6-jbgjh\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:21:15.529447 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:15.529353 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:21:15.850529 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:15.850497 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tmngv" Jun 03 00:21:15.914613 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:15.914580 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" event={"ID":"0b1238f1-e829-499b-aa6d-bf5dbfcace10","Type":"ContainerStarted","Data":"0728b1f8e70ca54720aa546c9df499f2bf41bce280d315fae589b55de018f2a5"} Jun 03 00:21:15.931532 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:15.931487 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-cbb5s" podStartSLOduration=33.698966971 podStartE2EDuration="35.931475186s" podCreationTimestamp="2026-06-03 00:20:40 +0000 UTC" firstStartedPulling="2026-06-03 00:21:12.642645328 +0000 UTC m=+98.730453270" lastFinishedPulling="2026-06-03 00:21:14.875153529 +0000 UTC m=+100.962961485" observedRunningTime="2026-06-03 00:21:15.930883242 +0000 UTC m=+102.018691218" watchObservedRunningTime="2026-06-03 00:21:15.931475186 +0000 UTC m=+102.019283150" Jun 03 00:21:16.095036 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.095008 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b5bc4bfc6-jbgjh"] Jun 03 00:21:16.098044 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:16.098015 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod123bf50e_24ce_443e_89ff_e27607685bb2.slice/crio-11eebfbb061704c14215b3a28dc1736cb42c9bd0a2393ca76f96e9990f49a82c WatchSource:0}: Error finding container 11eebfbb061704c14215b3a28dc1736cb42c9bd0a2393ca76f96e9990f49a82c: Status 404 returned error can't find the container with id 11eebfbb061704c14215b3a28dc1736cb42c9bd0a2393ca76f96e9990f49a82c Jun 03 00:21:16.770075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.769991 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:21:16.770075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.770044 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:21:16.772402 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.772379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eefd36b7-077a-4ffb-a886-28acaba8d024-metrics-tls\") pod \"dns-default-xdhhv\" (UID: \"eefd36b7-077a-4ffb-a886-28acaba8d024\") " pod="openshift-dns/dns-default-xdhhv" Jun 03 00:21:16.772459 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.772432 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffb74965-df28-4cbf-8cdf-21ef1f693101-cert\") pod \"ingress-canary-rk7hj\" (UID: \"ffb74965-df28-4cbf-8cdf-21ef1f693101\") " pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:21:16.920417 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.920384 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" event={"ID":"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191","Type":"ContainerStarted","Data":"d326b0462b8b3bbafc6b4c904f31eaf2742158ba8a9485fa5e67d3832604606b"} Jun 03 00:21:16.920417 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.920421 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" event={"ID":"c4d3f018-3a0d-4aa3-9dfb-e3f6bb91b191","Type":"ContainerStarted","Data":"434547da4366eba92e9144db3b40ff6c03d6fb33676529848d0709f59afdebf9"} Jun 03 00:21:16.921792 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.921763 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" event={"ID":"123bf50e-24ce-443e-89ff-e27607685bb2","Type":"ContainerStarted","Data":"a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f"} Jun 03 00:21:16.921919 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.921796 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" event={"ID":"123bf50e-24ce-443e-89ff-e27607685bb2","Type":"ContainerStarted","Data":"11eebfbb061704c14215b3a28dc1736cb42c9bd0a2393ca76f96e9990f49a82c"} Jun 03 00:21:16.921964 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.921916 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:21:16.936959 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.936918 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-d9dmh" podStartSLOduration=33.266176188 podStartE2EDuration="36.936906277s" podCreationTimestamp="2026-06-03 00:20:40 +0000 UTC" firstStartedPulling="2026-06-03 00:21:12.690370864 +0000 UTC m=+98.778178807" lastFinishedPulling="2026-06-03 00:21:16.36110095 +0000 UTC m=+102.448908896" observedRunningTime="2026-06-03 00:21:16.935415951 +0000 UTC m=+103.023223916" watchObservedRunningTime="2026-06-03 00:21:16.936906277 +0000 UTC m=+103.024714242" Jun 03 00:21:16.951325 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:16.951287 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" podStartSLOduration=33.951276705 podStartE2EDuration="33.951276705s" podCreationTimestamp="2026-06-03 00:20:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:21:16.950892779 +0000 UTC m=+103.038700802" watchObservedRunningTime="2026-06-03 00:21:16.951276705 +0000 UTC m=+103.039084670" Jun 03 00:21:17.034996 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.034933 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5c68x\"" Jun 03 00:21:17.042993 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.042975 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdhhv" Jun 03 00:21:17.045324 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.045304 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8cxnz\"" Jun 03 00:21:17.054241 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.054207 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rk7hj" Jun 03 00:21:17.170535 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.170502 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xdhhv"] Jun 03 00:21:17.173836 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:17.173801 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeefd36b7_077a_4ffb_a886_28acaba8d024.slice/crio-25561459b7178c465430ea311868161379d5612e81a74e5de312ce7ec189aead WatchSource:0}: Error finding container 25561459b7178c465430ea311868161379d5612e81a74e5de312ce7ec189aead: Status 404 returned error can't find the container with id 25561459b7178c465430ea311868161379d5612e81a74e5de312ce7ec189aead Jun 03 00:21:17.186220 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.186179 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rk7hj"] Jun 03 00:21:17.189082 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:17.189057 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb74965_df28_4cbf_8cdf_21ef1f693101.slice/crio-d48c25c6a5d0b057ff63fd729019200d456d1879e4f1ba291d7801ff6158f0ad WatchSource:0}: Error finding container d48c25c6a5d0b057ff63fd729019200d456d1879e4f1ba291d7801ff6158f0ad: Status 404 returned error can't find the container with id d48c25c6a5d0b057ff63fd729019200d456d1879e4f1ba291d7801ff6158f0ad Jun 03 00:21:17.682124 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.682085 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j"] Jun 03 00:21:17.691128 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.691105 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.693872 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.693842 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 03 00:21:17.696420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.695361 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 03 00:21:17.696420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.695507 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j"] Jun 03 00:21:17.696420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.695644 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 03 00:21:17.696420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.695874 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 03 00:21:17.696420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.695996 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 03 00:21:17.696420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.696078 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 03 00:21:17.696420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.696257 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 03 00:21:17.716538 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.716509 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b5bc4bfc6-jbgjh"] Jun 03 00:21:17.774497 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.774466 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hcjxk"] Jun 03 00:21:17.777456 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.777427 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.777601 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.777496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.777721 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.777699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/42aa3c34-119f-49a8-bfc9-791b3bc7308d-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.777794 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.777741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-ca\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.777794 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.777766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-hub\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.777898 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.777855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjzn\" (UniqueName: \"kubernetes.io/projected/42aa3c34-119f-49a8-bfc9-791b3bc7308d-kube-api-access-6bjzn\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.787956 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.787932 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.790523 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.790481 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ljkj8\"" Jun 03 00:21:17.790726 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.790710 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 00:21:17.790766 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.790758 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 00:21:17.790995 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.790961 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 00:21:17.791171 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.791153 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 00:21:17.799216 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.799174 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hcjxk"] Jun 03 00:21:17.878847 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.878813 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.879035 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.878874 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r87d\" (UniqueName: \"kubernetes.io/projected/5dcc9a34-1045-4d71-b332-240771005d85-kube-api-access-9r87d\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.879035 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.878910 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.879035 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.878938 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/42aa3c34-119f-49a8-bfc9-791b3bc7308d-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.879230 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.879073 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-ca\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.879230 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.879099 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-hub\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.879230 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.879128 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dcc9a34-1045-4d71-b332-240771005d85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.879230 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.879178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dcc9a34-1045-4d71-b332-240771005d85-data-volume\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.879230 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.879223 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dcc9a34-1045-4d71-b332-240771005d85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.879479 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.879288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dcc9a34-1045-4d71-b332-240771005d85-crio-socket\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.879479 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.879331 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjzn\" (UniqueName: \"kubernetes.io/projected/42aa3c34-119f-49a8-bfc9-791b3bc7308d-kube-api-access-6bjzn\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.880136 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.880088 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/42aa3c34-119f-49a8-bfc9-791b3bc7308d-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.882660 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.882615 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-hub\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.882778 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.882727 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-ca\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.882843 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.882799 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.883244 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.883222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/42aa3c34-119f-49a8-bfc9-791b3bc7308d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.887254 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.887231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjzn\" (UniqueName: \"kubernetes.io/projected/42aa3c34-119f-49a8-bfc9-791b3bc7308d-kube-api-access-6bjzn\") pod \"cluster-proxy-proxy-agent-5c454ffd78-lkg9j\" (UID: \"42aa3c34-119f-49a8-bfc9-791b3bc7308d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:17.927265 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.927232 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rk7hj" event={"ID":"ffb74965-df28-4cbf-8cdf-21ef1f693101","Type":"ContainerStarted","Data":"d48c25c6a5d0b057ff63fd729019200d456d1879e4f1ba291d7801ff6158f0ad"} Jun 03 00:21:17.928894 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.928739 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdhhv" event={"ID":"eefd36b7-077a-4ffb-a886-28acaba8d024","Type":"ContainerStarted","Data":"25561459b7178c465430ea311868161379d5612e81a74e5de312ce7ec189aead"} Jun 03 00:21:17.981052 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.980472 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dcc9a34-1045-4d71-b332-240771005d85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.981052 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.980543 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dcc9a34-1045-4d71-b332-240771005d85-data-volume\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.981052 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.980574 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dcc9a34-1045-4d71-b332-240771005d85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.981052 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.980615 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dcc9a34-1045-4d71-b332-240771005d85-crio-socket\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.981052 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.980671 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9r87d\" (UniqueName: \"kubernetes.io/projected/5dcc9a34-1045-4d71-b332-240771005d85-kube-api-access-9r87d\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.981052 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.980922 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dcc9a34-1045-4d71-b332-240771005d85-data-volume\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.981052 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.981018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dcc9a34-1045-4d71-b332-240771005d85-crio-socket\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.981543 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.981512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dcc9a34-1045-4d71-b332-240771005d85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.983768 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.983737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dcc9a34-1045-4d71-b332-240771005d85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:17.988821 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:17.988795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r87d\" (UniqueName: \"kubernetes.io/projected/5dcc9a34-1045-4d71-b332-240771005d85-kube-api-access-9r87d\") pod \"insights-runtime-extractor-hcjxk\" (UID: \"5dcc9a34-1045-4d71-b332-240771005d85\") " pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:18.012971 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:18.012945 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" Jun 03 00:21:18.100708 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:18.100318 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hcjxk" Jun 03 00:21:18.157764 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:18.157735 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j"] Jun 03 00:21:18.178264 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:18.171092 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod42aa3c34_119f_49a8_bfc9_791b3bc7308d.slice/crio-4b49c7690dd96fe0012bc7e89cdeb775bfcf53d37de09aa490c093ba9da0a9a2 WatchSource:0}: Error finding container 4b49c7690dd96fe0012bc7e89cdeb775bfcf53d37de09aa490c093ba9da0a9a2: Status 404 returned error can't find the container with id 4b49c7690dd96fe0012bc7e89cdeb775bfcf53d37de09aa490c093ba9da0a9a2 Jun 03 00:21:18.240860 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:18.240755 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hcjxk"] Jun 03 00:21:18.661383 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:18.661346 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dcc9a34_1045_4d71_b332_240771005d85.slice/crio-0d9399867dc9d25d713deeb8d9c4fefc5e4fffd379b3e7a51ce770371c009ef8 WatchSource:0}: Error finding container 0d9399867dc9d25d713deeb8d9c4fefc5e4fffd379b3e7a51ce770371c009ef8: Status 404 returned error can't find the container with id 0d9399867dc9d25d713deeb8d9c4fefc5e4fffd379b3e7a51ce770371c009ef8 Jun 03 00:21:18.932652 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:18.932571 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hcjxk" event={"ID":"5dcc9a34-1045-4d71-b332-240771005d85","Type":"ContainerStarted","Data":"f17132c02b44d21c47dd33796ab097d3cd69da3bf4395abfa5296fc62bc88ede"} Jun 03 00:21:18.932652 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:18.932616 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hcjxk" event={"ID":"5dcc9a34-1045-4d71-b332-240771005d85","Type":"ContainerStarted","Data":"0d9399867dc9d25d713deeb8d9c4fefc5e4fffd379b3e7a51ce770371c009ef8"} Jun 03 00:21:18.933556 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:18.933536 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" event={"ID":"42aa3c34-119f-49a8-bfc9-791b3bc7308d","Type":"ContainerStarted","Data":"4b49c7690dd96fe0012bc7e89cdeb775bfcf53d37de09aa490c093ba9da0a9a2"} Jun 03 00:21:19.943960 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:19.940300 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rk7hj" event={"ID":"ffb74965-df28-4cbf-8cdf-21ef1f693101","Type":"ContainerStarted","Data":"3859be730e54cb1d72d32fd65e03464ffb22b9c9277e8c01d6d4e1ccd21c8fa0"} Jun 03 00:21:19.944897 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:19.944865 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hcjxk" event={"ID":"5dcc9a34-1045-4d71-b332-240771005d85","Type":"ContainerStarted","Data":"e467f30382e42eb2b859d642bf4bd359f5239e63c056cdda686326c9b588d86c"} Jun 03 00:21:19.947568 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:19.947513 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdhhv" event={"ID":"eefd36b7-077a-4ffb-a886-28acaba8d024","Type":"ContainerStarted","Data":"d57429f05afb077272203dda6ed6df498e5266e0c7ba6f4139031a2c56390cda"} Jun 03 00:21:19.947568 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:19.947549 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdhhv" event={"ID":"eefd36b7-077a-4ffb-a886-28acaba8d024","Type":"ContainerStarted","Data":"27862315d68d16baa23ccfc49a516abe5322b3b49e4b49fb5e324f66866e3aa7"} Jun 03 00:21:19.947810 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:19.947789 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xdhhv" Jun 03 00:21:19.957539 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:19.957494 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rk7hj" podStartSLOduration=65.65618156 podStartE2EDuration="1m7.957481278s" podCreationTimestamp="2026-06-03 00:20:12 +0000 UTC" firstStartedPulling="2026-06-03 00:21:17.190883232 +0000 UTC m=+103.278691188" lastFinishedPulling="2026-06-03 00:21:19.492182946 +0000 UTC m=+105.579990906" observedRunningTime="2026-06-03 00:21:19.956307433 +0000 UTC m=+106.044115398" watchObservedRunningTime="2026-06-03 00:21:19.957481278 +0000 UTC m=+106.045289240" Jun 03 00:21:19.972115 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:19.972060 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-xdhhv" podStartSLOduration=65.678790649 podStartE2EDuration="1m7.972043582s" podCreationTimestamp="2026-06-03 00:20:12 +0000 UTC" firstStartedPulling="2026-06-03 00:21:17.175653959 +0000 UTC m=+103.263461902" lastFinishedPulling="2026-06-03 00:21:19.468906879 +0000 UTC m=+105.556714835" observedRunningTime="2026-06-03 00:21:19.971036872 +0000 UTC m=+106.058844839" watchObservedRunningTime="2026-06-03 00:21:19.972043582 +0000 UTC m=+106.059851550" Jun 03 00:21:21.955207 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:21.955104 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hcjxk" event={"ID":"5dcc9a34-1045-4d71-b332-240771005d85","Type":"ContainerStarted","Data":"a16cbc369866453357b9a655281e04ae1bc8c5286aca8e953badb7ae32898268"} Jun 03 00:21:21.973345 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:21.973302 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hcjxk" podStartSLOduration=2.121758856 podStartE2EDuration="4.973289701s" podCreationTimestamp="2026-06-03 00:21:17 +0000 UTC" firstStartedPulling="2026-06-03 00:21:18.766960649 +0000 UTC m=+104.854768607" lastFinishedPulling="2026-06-03 00:21:21.618491508 +0000 UTC m=+107.706299452" observedRunningTime="2026-06-03 00:21:21.971999506 +0000 UTC m=+108.059807492" watchObservedRunningTime="2026-06-03 00:21:21.973289701 +0000 UTC m=+108.061097662" Jun 03 00:21:23.965796 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:23.965751 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" event={"ID":"42aa3c34-119f-49a8-bfc9-791b3bc7308d","Type":"ContainerStarted","Data":"df5cc9ffd64dde58ce5de560733b299150146b8d9fe4cd2e0756909b8516b7e1"} Jun 03 00:21:25.972578 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:25.972549 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" event={"ID":"42aa3c34-119f-49a8-bfc9-791b3bc7308d","Type":"ContainerStarted","Data":"2eb50fad4f84039890fec86f19132ac507754f51ec33d5c88f8793da8c98fec0"} Jun 03 00:21:26.976823 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:26.976785 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" event={"ID":"42aa3c34-119f-49a8-bfc9-791b3bc7308d","Type":"ContainerStarted","Data":"9beaa7c70ed1eab006bdedf81d3c52e8cdc93527c54aae44ae8ee975daf77b82"} Jun 03 00:21:26.993788 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:26.993746 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5c454ffd78-lkg9j" podStartSLOduration=2.322240612 podStartE2EDuration="9.993732895s" podCreationTimestamp="2026-06-03 00:21:17 +0000 UTC" firstStartedPulling="2026-06-03 00:21:18.180400053 +0000 UTC m=+104.268208003" lastFinishedPulling="2026-06-03 00:21:25.85189234 +0000 UTC m=+111.939700286" observedRunningTime="2026-06-03 00:21:26.992498714 +0000 UTC m=+113.080306678" watchObservedRunningTime="2026-06-03 00:21:26.993732895 +0000 UTC m=+113.081540860" Jun 03 00:21:27.753996 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.753960 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ldwb6"] Jun 03 00:21:27.755975 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.755954 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.758672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.758488 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 00:21:27.758672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.758540 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vbjhq\"" Jun 03 00:21:27.758672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.758549 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 00:21:27.758672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.758616 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 00:21:27.758672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.758553 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 00:21:27.761011 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.760991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-textfile\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.761127 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.761019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bd7967e-5cda-44a5-b758-f6f3459f62df-metrics-client-ca\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.761127 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.761041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-tls\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.761127 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.761083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-wtmp\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.761309 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.761125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-accelerators-collector-config\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.761309 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.761156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-sys\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.761309 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.761220 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-root\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.761309 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.761273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkfsv\" (UniqueName: \"kubernetes.io/projected/5bd7967e-5cda-44a5-b758-f6f3459f62df-kube-api-access-wkfsv\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.761503 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.761309 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.861824 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.861788 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-accelerators-collector-config\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.861999 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.861840 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-sys\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.861999 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.861866 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-root\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.861999 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.861900 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wkfsv\" (UniqueName: \"kubernetes.io/projected/5bd7967e-5cda-44a5-b758-f6f3459f62df-kube-api-access-wkfsv\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.861999 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.861930 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.861999 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.861989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-sys\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862180 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.861991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-root\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862353 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.862330 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-textfile\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862479 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.862364 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bd7967e-5cda-44a5-b758-f6f3459f62df-metrics-client-ca\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862479 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.862386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-accelerators-collector-config\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862479 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.862391 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-tls\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862479 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.862451 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-wtmp\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862670 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:21:27.862597 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 00:21:27.862670 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.862623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-wtmp\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862670 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.862625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-textfile\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.862670 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:21:27.862650 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-tls podName:5bd7967e-5cda-44a5-b758-f6f3459f62df nodeName:}" failed. No retries permitted until 2026-06-03 00:21:28.362632265 +0000 UTC m=+114.450440215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-tls") pod "node-exporter-ldwb6" (UID: "5bd7967e-5cda-44a5-b758-f6f3459f62df") : secret "node-exporter-tls" not found Jun 03 00:21:27.863099 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.863080 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bd7967e-5cda-44a5-b758-f6f3459f62df-metrics-client-ca\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.864795 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.864766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:27.870214 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:27.870180 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkfsv\" (UniqueName: \"kubernetes.io/projected/5bd7967e-5cda-44a5-b758-f6f3459f62df-kube-api-access-wkfsv\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:28.366786 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:28.366753 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-tls\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:28.369010 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:28.368991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5bd7967e-5cda-44a5-b758-f6f3459f62df-node-exporter-tls\") pod \"node-exporter-ldwb6\" (UID: \"5bd7967e-5cda-44a5-b758-f6f3459f62df\") " pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:28.666419 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:28.666340 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ldwb6" Jun 03 00:21:28.675537 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:28.675508 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd7967e_5cda_44a5_b758_f6f3459f62df.slice/crio-31a446b01ab96c2951133f0fc5e89442d21ceb8e673989d1516279116554953a WatchSource:0}: Error finding container 31a446b01ab96c2951133f0fc5e89442d21ceb8e673989d1516279116554953a: Status 404 returned error can't find the container with id 31a446b01ab96c2951133f0fc5e89442d21ceb8e673989d1516279116554953a Jun 03 00:21:28.982763 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:28.982680 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ldwb6" event={"ID":"5bd7967e-5cda-44a5-b758-f6f3459f62df","Type":"ContainerStarted","Data":"31a446b01ab96c2951133f0fc5e89442d21ceb8e673989d1516279116554953a"} Jun 03 00:21:29.826477 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.826450 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-599b585758-nqdvs"] Jun 03 00:21:29.829645 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.829624 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.832165 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.832145 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 00:21:29.832488 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.832310 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bhfq4613gt64n\"" Jun 03 00:21:29.832488 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.832415 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 00:21:29.832680 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.832662 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 00:21:29.833237 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.833216 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 00:21:29.833323 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.833261 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zjdbs\"" Jun 03 00:21:29.833323 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.833261 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 00:21:29.839412 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.839388 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-599b585758-nqdvs"] Jun 03 00:21:29.878710 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.878682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.878795 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.878714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh5mz\" (UniqueName: \"kubernetes.io/projected/94de7b2a-d874-4671-89f9-95a1d55e1eed-kube-api-access-hh5mz\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.878795 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.878750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.878795 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.878789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.878964 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.878811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.878964 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.878855 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-tls\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.878964 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.878897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-grpc-tls\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.878964 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.878915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94de7b2a-d874-4671-89f9-95a1d55e1eed-metrics-client-ca\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.953329 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.953272 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xdhhv" Jun 03 00:21:29.979316 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.979289 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.979316 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.979326 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hh5mz\" (UniqueName: \"kubernetes.io/projected/94de7b2a-d874-4671-89f9-95a1d55e1eed-kube-api-access-hh5mz\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.979512 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.979369 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.979512 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.979415 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.979512 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.979463 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.979662 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.979510 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-tls\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.979662 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.979541 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-grpc-tls\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.979662 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.979570 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94de7b2a-d874-4671-89f9-95a1d55e1eed-metrics-client-ca\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.980339 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.980317 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/94de7b2a-d874-4671-89f9-95a1d55e1eed-metrics-client-ca\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.983049 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.983006 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.983049 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.983035 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.983613 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.983423 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-grpc-tls\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.984102 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.984059 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.984374 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.984355 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-tls\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.985055 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.985025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/94de7b2a-d874-4671-89f9-95a1d55e1eed-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:29.987300 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.987272 2574 generic.go:358] "Generic (PLEG): container finished" podID="5bd7967e-5cda-44a5-b758-f6f3459f62df" containerID="be2054f887918efed592c16d3deceeb1b40369df57e307cd70cff7ce4c47d7cb" exitCode=0 Jun 03 00:21:29.987384 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.987357 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ldwb6" event={"ID":"5bd7967e-5cda-44a5-b758-f6f3459f62df","Type":"ContainerDied","Data":"be2054f887918efed592c16d3deceeb1b40369df57e307cd70cff7ce4c47d7cb"} Jun 03 00:21:29.988056 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:29.988032 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh5mz\" (UniqueName: \"kubernetes.io/projected/94de7b2a-d874-4671-89f9-95a1d55e1eed-kube-api-access-hh5mz\") pod \"thanos-querier-599b585758-nqdvs\" (UID: \"94de7b2a-d874-4671-89f9-95a1d55e1eed\") " pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:30.185555 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:30.185514 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:30.308664 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:30.308630 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-599b585758-nqdvs"] Jun 03 00:21:30.311391 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:30.311362 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94de7b2a_d874_4671_89f9_95a1d55e1eed.slice/crio-05b5d3bb9a0e0d6619ea2a573ac1afac862dc109e87ae462401d3ab56ca208b8 WatchSource:0}: Error finding container 05b5d3bb9a0e0d6619ea2a573ac1afac862dc109e87ae462401d3ab56ca208b8: Status 404 returned error can't find the container with id 05b5d3bb9a0e0d6619ea2a573ac1afac862dc109e87ae462401d3ab56ca208b8 Jun 03 00:21:30.991049 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:30.991008 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" event={"ID":"94de7b2a-d874-4671-89f9-95a1d55e1eed","Type":"ContainerStarted","Data":"05b5d3bb9a0e0d6619ea2a573ac1afac862dc109e87ae462401d3ab56ca208b8"} Jun 03 00:21:30.993070 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:30.993033 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ldwb6" event={"ID":"5bd7967e-5cda-44a5-b758-f6f3459f62df","Type":"ContainerStarted","Data":"0e9ca811ab7cb24ac0d52f0a0333e22bde6768dad3177565c8de6b658955a7a9"} Jun 03 00:21:30.993234 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:30.993077 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ldwb6" event={"ID":"5bd7967e-5cda-44a5-b758-f6f3459f62df","Type":"ContainerStarted","Data":"76e9710011f9f25c8c0b4bfef459d356688def2c4d17f7ae589496cec5f4def3"} Jun 03 00:21:31.013154 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:31.013107 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ldwb6" podStartSLOduration=2.988139491 podStartE2EDuration="4.013092284s" podCreationTimestamp="2026-06-03 00:21:27 +0000 UTC" firstStartedPulling="2026-06-03 00:21:28.677481009 +0000 UTC m=+114.765288952" lastFinishedPulling="2026-06-03 00:21:29.702433797 +0000 UTC m=+115.790241745" observedRunningTime="2026-06-03 00:21:31.012351522 +0000 UTC m=+117.100159487" watchObservedRunningTime="2026-06-03 00:21:31.013092284 +0000 UTC m=+117.100900249" Jun 03 00:21:33.001458 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:33.001417 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" event={"ID":"94de7b2a-d874-4671-89f9-95a1d55e1eed","Type":"ContainerStarted","Data":"54f7bb65bb61edddd113c072fe58d016801a73407c1b2078974db5f2e8c6b299"} Jun 03 00:21:33.001458 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:33.001467 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" event={"ID":"94de7b2a-d874-4671-89f9-95a1d55e1eed","Type":"ContainerStarted","Data":"b7f7811d3fd118d6d0366b78c7200639ea2571af08a366aed5a00d0cddabe4ca"} Jun 03 00:21:33.001915 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:33.001482 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" event={"ID":"94de7b2a-d874-4671-89f9-95a1d55e1eed","Type":"ContainerStarted","Data":"194d956110e4f462e2ca3f1485c3163d96148b9750da2b30291b2450a2cdc069"} Jun 03 00:21:34.007162 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:34.007124 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" event={"ID":"94de7b2a-d874-4671-89f9-95a1d55e1eed","Type":"ContainerStarted","Data":"d3d21839945c6417c9e1360dacb8255f8171479a967d76a4afd3028740962624"} Jun 03 00:21:34.007162 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:34.007161 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" event={"ID":"94de7b2a-d874-4671-89f9-95a1d55e1eed","Type":"ContainerStarted","Data":"d7cf50bdab133a8866e7dff6142b613c0f55e0b96ac4006886232bbe07d2e047"} Jun 03 00:21:34.007682 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:34.007172 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" event={"ID":"94de7b2a-d874-4671-89f9-95a1d55e1eed","Type":"ContainerStarted","Data":"bcb03e6e173a5f72ff24cb48efc396efbf029ac9eb8fea3a20053ce5fb36f689"} Jun 03 00:21:34.007682 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:34.007396 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:34.027359 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:34.027311 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" podStartSLOduration=2.021664036 podStartE2EDuration="5.027297692s" podCreationTimestamp="2026-06-03 00:21:29 +0000 UTC" firstStartedPulling="2026-06-03 00:21:30.313223546 +0000 UTC m=+116.401031489" lastFinishedPulling="2026-06-03 00:21:33.318857199 +0000 UTC m=+119.406665145" observedRunningTime="2026-06-03 00:21:34.026135159 +0000 UTC m=+120.113943124" watchObservedRunningTime="2026-06-03 00:21:34.027297692 +0000 UTC m=+120.115105651" Jun 03 00:21:38.939149 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:38.939121 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:21:40.016147 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:40.016118 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-599b585758-nqdvs" Jun 03 00:21:43.952323 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:43.952256 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" podUID="123bf50e-24ce-443e-89ff-e27607685bb2" containerName="registry" containerID="cri-o://a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f" gracePeriod=30 Jun 03 00:21:44.189051 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.189026 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:21:44.292650 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.292562 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123bf50e-24ce-443e-89ff-e27607685bb2-ca-trust-extracted\") pod \"123bf50e-24ce-443e-89ff-e27607685bb2\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " Jun 03 00:21:44.292650 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.292605 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") pod \"123bf50e-24ce-443e-89ff-e27607685bb2\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " Jun 03 00:21:44.292650 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.292626 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-image-registry-private-configuration\") pod \"123bf50e-24ce-443e-89ff-e27607685bb2\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " Jun 03 00:21:44.292650 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.292649 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xch6\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-kube-api-access-9xch6\") pod \"123bf50e-24ce-443e-89ff-e27607685bb2\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " Jun 03 00:21:44.292977 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.292694 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-trusted-ca\") pod \"123bf50e-24ce-443e-89ff-e27607685bb2\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " Jun 03 00:21:44.292977 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.292779 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-installation-pull-secrets\") pod \"123bf50e-24ce-443e-89ff-e27607685bb2\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " Jun 03 00:21:44.292977 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.292822 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-bound-sa-token\") pod \"123bf50e-24ce-443e-89ff-e27607685bb2\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " Jun 03 00:21:44.292977 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.292886 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-registry-certificates\") pod \"123bf50e-24ce-443e-89ff-e27607685bb2\" (UID: \"123bf50e-24ce-443e-89ff-e27607685bb2\") " Jun 03 00:21:44.293164 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.293034 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:21:44.293265 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.293181 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "123bf50e-24ce-443e-89ff-e27607685bb2" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:21:44.293677 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.293470 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "123bf50e-24ce-443e-89ff-e27607685bb2" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:21:44.295729 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.295683 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "123bf50e-24ce-443e-89ff-e27607685bb2" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:21:44.295842 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.295797 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "123bf50e-24ce-443e-89ff-e27607685bb2" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:21:44.295982 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.295956 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "123bf50e-24ce-443e-89ff-e27607685bb2" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 00:21:44.296088 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.296006 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-kube-api-access-9xch6" (OuterVolumeSpecName: "kube-api-access-9xch6") pod "123bf50e-24ce-443e-89ff-e27607685bb2" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2"). InnerVolumeSpecName "kube-api-access-9xch6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:21:44.296088 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.296064 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "123bf50e-24ce-443e-89ff-e27607685bb2" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:21:44.296155 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.296084 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3b116e3e-08e8-4935-8ae4-8a9b932a43b3-metrics-certs\") pod \"network-metrics-daemon-8hgnw\" (UID: \"3b116e3e-08e8-4935-8ae4-8a9b932a43b3\") " pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:21:44.304457 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.304429 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/123bf50e-24ce-443e-89ff-e27607685bb2-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "123bf50e-24ce-443e-89ff-e27607685bb2" (UID: "123bf50e-24ce-443e-89ff-e27607685bb2"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 00:21:44.331660 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.331632 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-88bpn\"" Jun 03 00:21:44.339718 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.339695 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8hgnw" Jun 03 00:21:44.394601 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.394565 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/123bf50e-24ce-443e-89ff-e27607685bb2-ca-trust-extracted\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:21:44.394601 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.394604 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-registry-tls\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:21:44.394781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.394620 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-image-registry-private-configuration\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:21:44.394781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.394636 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xch6\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-kube-api-access-9xch6\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:21:44.394781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.394650 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-trusted-ca\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:21:44.394781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.394666 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/123bf50e-24ce-443e-89ff-e27607685bb2-installation-pull-secrets\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:21:44.394781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.394680 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/123bf50e-24ce-443e-89ff-e27607685bb2-bound-sa-token\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:21:44.394781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.394694 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/123bf50e-24ce-443e-89ff-e27607685bb2-registry-certificates\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:21:44.464023 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:44.463991 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8hgnw"] Jun 03 00:21:44.466833 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:21:44.466802 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b116e3e_08e8_4935_8ae4_8a9b932a43b3.slice/crio-e26e0a98ef1289e7ca73e5eb16bfd743604d60a76a3cbb25580d498fd0ab96c9 WatchSource:0}: Error finding container e26e0a98ef1289e7ca73e5eb16bfd743604d60a76a3cbb25580d498fd0ab96c9: Status 404 returned error can't find the container with id e26e0a98ef1289e7ca73e5eb16bfd743604d60a76a3cbb25580d498fd0ab96c9 Jun 03 00:21:45.036920 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.036830 2574 generic.go:358] "Generic (PLEG): container finished" podID="123bf50e-24ce-443e-89ff-e27607685bb2" containerID="a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f" exitCode=0 Jun 03 00:21:45.037389 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.036925 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" Jun 03 00:21:45.037389 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.036923 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" event={"ID":"123bf50e-24ce-443e-89ff-e27607685bb2","Type":"ContainerDied","Data":"a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f"} Jun 03 00:21:45.037389 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.036968 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b5bc4bfc6-jbgjh" event={"ID":"123bf50e-24ce-443e-89ff-e27607685bb2","Type":"ContainerDied","Data":"11eebfbb061704c14215b3a28dc1736cb42c9bd0a2393ca76f96e9990f49a82c"} Jun 03 00:21:45.037389 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.036988 2574 scope.go:117] "RemoveContainer" containerID="a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f" Jun 03 00:21:45.038693 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.038668 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hgnw" event={"ID":"3b116e3e-08e8-4935-8ae4-8a9b932a43b3","Type":"ContainerStarted","Data":"e26e0a98ef1289e7ca73e5eb16bfd743604d60a76a3cbb25580d498fd0ab96c9"} Jun 03 00:21:45.046048 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.046030 2574 scope.go:117] "RemoveContainer" containerID="a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f" Jun 03 00:21:45.046353 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:21:45.046329 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f\": container with ID starting with a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f not found: ID does not exist" containerID="a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f" Jun 03 00:21:45.046425 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.046366 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f"} err="failed to get container status \"a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f\": rpc error: code = NotFound desc = could not find container \"a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f\": container with ID starting with a7faffd61bc0faeaa0c71713f2695224af35e7aa0fbdb0098a5f25c3aa89412f not found: ID does not exist" Jun 03 00:21:45.052671 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.052647 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b5bc4bfc6-jbgjh"] Jun 03 00:21:45.060757 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:45.060732 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b5bc4bfc6-jbgjh"] Jun 03 00:21:46.622380 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:46.622351 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="123bf50e-24ce-443e-89ff-e27607685bb2" path="/var/lib/kubelet/pods/123bf50e-24ce-443e-89ff-e27607685bb2/volumes" Jun 03 00:21:47.049094 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:47.049018 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hgnw" event={"ID":"3b116e3e-08e8-4935-8ae4-8a9b932a43b3","Type":"ContainerStarted","Data":"11119650c40195e8a394bc00b19f5bdb565640d1d8171108c7ef3396a88e380f"} Jun 03 00:21:47.049094 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:47.049054 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8hgnw" event={"ID":"3b116e3e-08e8-4935-8ae4-8a9b932a43b3","Type":"ContainerStarted","Data":"2272df0c653ccc396582fa2c40f65b078342d1251fa66c1b976fb05dc8875b3a"} Jun 03 00:21:47.063642 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:47.063592 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8hgnw" podStartSLOduration=131.533572458 podStartE2EDuration="2m13.063578645s" podCreationTimestamp="2026-06-03 00:19:34 +0000 UTC" firstStartedPulling="2026-06-03 00:21:44.468573065 +0000 UTC m=+130.556381007" lastFinishedPulling="2026-06-03 00:21:45.998579248 +0000 UTC m=+132.086387194" observedRunningTime="2026-06-03 00:21:47.063355784 +0000 UTC m=+133.151163750" watchObservedRunningTime="2026-06-03 00:21:47.063578645 +0000 UTC m=+133.151386610" Jun 03 00:21:58.079213 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:58.079174 2574 generic.go:358] "Generic (PLEG): container finished" podID="2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc" containerID="5710074c0532f4d571928d79062d174ac87d1f1b4dfa54087419366081f27ae9" exitCode=0 Jun 03 00:21:58.079625 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:58.079250 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" event={"ID":"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc","Type":"ContainerDied","Data":"5710074c0532f4d571928d79062d174ac87d1f1b4dfa54087419366081f27ae9"} Jun 03 00:21:58.079625 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:58.079543 2574 scope.go:117] "RemoveContainer" containerID="5710074c0532f4d571928d79062d174ac87d1f1b4dfa54087419366081f27ae9" Jun 03 00:21:59.083646 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:21:59.083612 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-69877444c-8c8jm" event={"ID":"2acdf7b9-ed15-4af2-bc1e-e71a665ab4fc","Type":"ContainerStarted","Data":"08ba4939ac59bcb1665091cd94e22032616c86516f028f00ff723b87e88c85fc"} Jun 03 00:24:34.494948 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:24:34.494917 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:24:34.498158 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:24:34.498131 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:24:34.501230 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:24:34.501208 2574 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 00:26:07.990491 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:07.990454 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh"] Jun 03 00:26:07.991103 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:07.990705 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="123bf50e-24ce-443e-89ff-e27607685bb2" containerName="registry" Jun 03 00:26:07.991103 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:07.990715 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="123bf50e-24ce-443e-89ff-e27607685bb2" containerName="registry" Jun 03 00:26:07.991103 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:07.990768 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="123bf50e-24ce-443e-89ff-e27607685bb2" containerName="registry" Jun 03 00:26:07.992412 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:07.992397 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" Jun 03 00:26:07.994971 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:07.994945 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:26:07.995071 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:07.995028 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jkghs\"" Jun 03 00:26:07.995125 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:07.995107 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 00:26:08.001412 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.001389 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh"] Jun 03 00:26:08.166642 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.166607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7b5p\" (UniqueName: \"kubernetes.io/projected/e91c598a-d0e6-4c0e-bf82-c4dcd85f557b-kube-api-access-d7b5p\") pod \"cert-manager-operator-controller-manager-54b9655956-vvjnh\" (UID: \"e91c598a-d0e6-4c0e-bf82-c4dcd85f557b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" Jun 03 00:26:08.166817 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.166660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91c598a-d0e6-4c0e-bf82-c4dcd85f557b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-vvjnh\" (UID: \"e91c598a-d0e6-4c0e-bf82-c4dcd85f557b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" Jun 03 00:26:08.267806 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.267732 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91c598a-d0e6-4c0e-bf82-c4dcd85f557b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-vvjnh\" (UID: \"e91c598a-d0e6-4c0e-bf82-c4dcd85f557b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" Jun 03 00:26:08.267917 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.267813 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7b5p\" (UniqueName: \"kubernetes.io/projected/e91c598a-d0e6-4c0e-bf82-c4dcd85f557b-kube-api-access-d7b5p\") pod \"cert-manager-operator-controller-manager-54b9655956-vvjnh\" (UID: \"e91c598a-d0e6-4c0e-bf82-c4dcd85f557b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" Jun 03 00:26:08.268175 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.268157 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e91c598a-d0e6-4c0e-bf82-c4dcd85f557b-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-vvjnh\" (UID: \"e91c598a-d0e6-4c0e-bf82-c4dcd85f557b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" Jun 03 00:26:08.276643 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.276617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7b5p\" (UniqueName: \"kubernetes.io/projected/e91c598a-d0e6-4c0e-bf82-c4dcd85f557b-kube-api-access-d7b5p\") pod \"cert-manager-operator-controller-manager-54b9655956-vvjnh\" (UID: \"e91c598a-d0e6-4c0e-bf82-c4dcd85f557b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" Jun 03 00:26:08.301376 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.301353 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" Jun 03 00:26:08.431382 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.431350 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh"] Jun 03 00:26:08.434524 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:26:08.434498 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode91c598a_d0e6_4c0e_bf82_c4dcd85f557b.slice/crio-ec9e532759e4b01d6442c65b832478ca3721bc9db1bab4508c8abd82c4f4d031 WatchSource:0}: Error finding container ec9e532759e4b01d6442c65b832478ca3721bc9db1bab4508c8abd82c4f4d031: Status 404 returned error can't find the container with id ec9e532759e4b01d6442c65b832478ca3721bc9db1bab4508c8abd82c4f4d031 Jun 03 00:26:08.437057 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.437037 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:26:08.735312 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:08.735274 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" event={"ID":"e91c598a-d0e6-4c0e-bf82-c4dcd85f557b","Type":"ContainerStarted","Data":"ec9e532759e4b01d6442c65b832478ca3721bc9db1bab4508c8abd82c4f4d031"} Jun 03 00:26:10.742955 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:10.742915 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" event={"ID":"e91c598a-d0e6-4c0e-bf82-c4dcd85f557b","Type":"ContainerStarted","Data":"06b2580b743cd9baacfb95be7409f553789e0758b4f27512f9a7f0b264b05ebf"} Jun 03 00:26:10.766784 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:10.766733 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-vvjnh" podStartSLOduration=2.146037262 podStartE2EDuration="3.766716929s" podCreationTimestamp="2026-06-03 00:26:07 +0000 UTC" firstStartedPulling="2026-06-03 00:26:08.437170996 +0000 UTC m=+394.524978939" lastFinishedPulling="2026-06-03 00:26:10.05785066 +0000 UTC m=+396.145658606" observedRunningTime="2026-06-03 00:26:10.763990119 +0000 UTC m=+396.851798086" watchObservedRunningTime="2026-06-03 00:26:10.766716929 +0000 UTC m=+396.854524893" Jun 03 00:26:23.170390 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.170357 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-v8tk5"] Jun 03 00:26:23.173374 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.173357 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-v8tk5" Jun 03 00:26:23.175840 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.175794 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-pbb54\"" Jun 03 00:26:23.175972 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.175836 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 00:26:23.176805 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.176787 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 00:26:23.180785 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.180761 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-v8tk5"] Jun 03 00:26:23.268975 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.268937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d60a8e9e-7d25-4824-a447-d0135fdc7e26-bound-sa-token\") pod \"cert-manager-79c8d999ff-v8tk5\" (UID: \"d60a8e9e-7d25-4824-a447-d0135fdc7e26\") " pod="cert-manager/cert-manager-79c8d999ff-v8tk5" Jun 03 00:26:23.269144 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.268993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvkh6\" (UniqueName: \"kubernetes.io/projected/d60a8e9e-7d25-4824-a447-d0135fdc7e26-kube-api-access-hvkh6\") pod \"cert-manager-79c8d999ff-v8tk5\" (UID: \"d60a8e9e-7d25-4824-a447-d0135fdc7e26\") " pod="cert-manager/cert-manager-79c8d999ff-v8tk5" Jun 03 00:26:23.370281 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.370249 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d60a8e9e-7d25-4824-a447-d0135fdc7e26-bound-sa-token\") pod \"cert-manager-79c8d999ff-v8tk5\" (UID: \"d60a8e9e-7d25-4824-a447-d0135fdc7e26\") " pod="cert-manager/cert-manager-79c8d999ff-v8tk5" Jun 03 00:26:23.370479 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.370307 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hvkh6\" (UniqueName: \"kubernetes.io/projected/d60a8e9e-7d25-4824-a447-d0135fdc7e26-kube-api-access-hvkh6\") pod \"cert-manager-79c8d999ff-v8tk5\" (UID: \"d60a8e9e-7d25-4824-a447-d0135fdc7e26\") " pod="cert-manager/cert-manager-79c8d999ff-v8tk5" Jun 03 00:26:23.378072 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.378046 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d60a8e9e-7d25-4824-a447-d0135fdc7e26-bound-sa-token\") pod \"cert-manager-79c8d999ff-v8tk5\" (UID: \"d60a8e9e-7d25-4824-a447-d0135fdc7e26\") " pod="cert-manager/cert-manager-79c8d999ff-v8tk5" Jun 03 00:26:23.378244 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.378118 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvkh6\" (UniqueName: \"kubernetes.io/projected/d60a8e9e-7d25-4824-a447-d0135fdc7e26-kube-api-access-hvkh6\") pod \"cert-manager-79c8d999ff-v8tk5\" (UID: \"d60a8e9e-7d25-4824-a447-d0135fdc7e26\") " pod="cert-manager/cert-manager-79c8d999ff-v8tk5" Jun 03 00:26:23.482620 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.482514 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-v8tk5" Jun 03 00:26:23.605476 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.605372 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-v8tk5"] Jun 03 00:26:23.608221 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:26:23.608179 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd60a8e9e_7d25_4824_a447_d0135fdc7e26.slice/crio-6a86fb772d1eb938bf69fb8ac267664ffd4cbfd6967bdb6037c13612965f7531 WatchSource:0}: Error finding container 6a86fb772d1eb938bf69fb8ac267664ffd4cbfd6967bdb6037c13612965f7531: Status 404 returned error can't find the container with id 6a86fb772d1eb938bf69fb8ac267664ffd4cbfd6967bdb6037c13612965f7531 Jun 03 00:26:23.779519 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:23.779426 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-v8tk5" event={"ID":"d60a8e9e-7d25-4824-a447-d0135fdc7e26","Type":"ContainerStarted","Data":"6a86fb772d1eb938bf69fb8ac267664ffd4cbfd6967bdb6037c13612965f7531"} Jun 03 00:26:25.245817 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.245780 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd"] Jun 03 00:26:25.249142 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.249119 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" Jun 03 00:26:25.254587 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.254566 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 00:26:25.254726 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.254566 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 00:26:25.254726 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.254566 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zwr25\"" Jun 03 00:26:25.261097 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.261074 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd"] Jun 03 00:26:25.286040 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.286009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6-tmp\") pod \"openshift-lws-operator-bfc7f696d-rb8dd\" (UID: \"64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" Jun 03 00:26:25.286242 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.286079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtmpf\" (UniqueName: \"kubernetes.io/projected/64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6-kube-api-access-vtmpf\") pod \"openshift-lws-operator-bfc7f696d-rb8dd\" (UID: \"64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" Jun 03 00:26:25.387051 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.387012 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6-tmp\") pod \"openshift-lws-operator-bfc7f696d-rb8dd\" (UID: \"64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" Jun 03 00:26:25.387256 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.387164 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vtmpf\" (UniqueName: \"kubernetes.io/projected/64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6-kube-api-access-vtmpf\") pod \"openshift-lws-operator-bfc7f696d-rb8dd\" (UID: \"64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" Jun 03 00:26:25.387519 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.387484 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6-tmp\") pod \"openshift-lws-operator-bfc7f696d-rb8dd\" (UID: \"64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" Jun 03 00:26:25.395420 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.395386 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtmpf\" (UniqueName: \"kubernetes.io/projected/64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6-kube-api-access-vtmpf\") pod \"openshift-lws-operator-bfc7f696d-rb8dd\" (UID: \"64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" Jun 03 00:26:25.561624 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:25.561542 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" Jun 03 00:26:26.246261 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:26.246239 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd"] Jun 03 00:26:26.248662 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:26:26.248639 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64906a9e_bab0_4e4e_9bc2_1fc4c28ab0c6.slice/crio-e30d4a6e0a596533dfe4a1b3bd59f4a2d01aa2c2645475c2c8f81dc7b681e495 WatchSource:0}: Error finding container e30d4a6e0a596533dfe4a1b3bd59f4a2d01aa2c2645475c2c8f81dc7b681e495: Status 404 returned error can't find the container with id e30d4a6e0a596533dfe4a1b3bd59f4a2d01aa2c2645475c2c8f81dc7b681e495 Jun 03 00:26:26.789754 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:26.789712 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" event={"ID":"64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6","Type":"ContainerStarted","Data":"e30d4a6e0a596533dfe4a1b3bd59f4a2d01aa2c2645475c2c8f81dc7b681e495"} Jun 03 00:26:26.791516 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:26.791482 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-v8tk5" event={"ID":"d60a8e9e-7d25-4824-a447-d0135fdc7e26","Type":"ContainerStarted","Data":"19f6cc7490d0ff9e45bd56972d721c0a3abb651c8dbdbb73c8dbfb11c54efab5"} Jun 03 00:26:26.808348 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:26.808295 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-v8tk5" podStartSLOduration=1.229050713 podStartE2EDuration="3.808277638s" podCreationTimestamp="2026-06-03 00:26:23 +0000 UTC" firstStartedPulling="2026-06-03 00:26:23.610056503 +0000 UTC m=+409.697864461" lastFinishedPulling="2026-06-03 00:26:26.189283444 +0000 UTC m=+412.277091386" observedRunningTime="2026-06-03 00:26:26.806630273 +0000 UTC m=+412.894438239" watchObservedRunningTime="2026-06-03 00:26:26.808277638 +0000 UTC m=+412.896085603" Jun 03 00:26:28.804339 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:28.804235 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" event={"ID":"64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6","Type":"ContainerStarted","Data":"9fa67568cd071e664d990f9be455824664d8380f55895b6dc9c71b542b3a1be0"} Jun 03 00:26:28.819803 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:28.819726 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-rb8dd" podStartSLOduration=1.565912885 podStartE2EDuration="3.819713859s" podCreationTimestamp="2026-06-03 00:26:25 +0000 UTC" firstStartedPulling="2026-06-03 00:26:26.250140414 +0000 UTC m=+412.337948357" lastFinishedPulling="2026-06-03 00:26:28.503941384 +0000 UTC m=+414.591749331" observedRunningTime="2026-06-03 00:26:28.818937496 +0000 UTC m=+414.906745462" watchObservedRunningTime="2026-06-03 00:26:28.819713859 +0000 UTC m=+414.907521823" Jun 03 00:26:48.031430 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.031386 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz"] Jun 03 00:26:48.038012 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.037988 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.041465 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.041445 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 00:26:48.041711 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.041696 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 00:26:48.041797 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.041777 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 00:26:48.042239 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.042223 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zd9z4\"" Jun 03 00:26:48.042739 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.042722 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 00:26:48.051757 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.051734 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz"] Jun 03 00:26:48.163967 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.163935 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85gkq\" (UniqueName: \"kubernetes.io/projected/22e775fe-4fa5-4c35-9290-87ec14bd689b-kube-api-access-85gkq\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.164122 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.163987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22e775fe-4fa5-4c35-9290-87ec14bd689b-manifests\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.164122 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.164045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22e775fe-4fa5-4c35-9290-87ec14bd689b-tmp\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.164122 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.164070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22e775fe-4fa5-4c35-9290-87ec14bd689b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.164255 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.164143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22e775fe-4fa5-4c35-9290-87ec14bd689b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.265228 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.265177 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85gkq\" (UniqueName: \"kubernetes.io/projected/22e775fe-4fa5-4c35-9290-87ec14bd689b-kube-api-access-85gkq\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.265384 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.265248 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22e775fe-4fa5-4c35-9290-87ec14bd689b-manifests\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.265384 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.265270 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22e775fe-4fa5-4c35-9290-87ec14bd689b-tmp\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.265384 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.265290 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22e775fe-4fa5-4c35-9290-87ec14bd689b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.265518 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.265386 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22e775fe-4fa5-4c35-9290-87ec14bd689b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.265681 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.265664 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/22e775fe-4fa5-4c35-9290-87ec14bd689b-manifests\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.267670 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.267645 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22e775fe-4fa5-4c35-9290-87ec14bd689b-tmp\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.267781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.267767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/22e775fe-4fa5-4c35-9290-87ec14bd689b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.267841 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.267825 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22e775fe-4fa5-4c35-9290-87ec14bd689b-webhook-cert\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.274461 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.274436 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85gkq\" (UniqueName: \"kubernetes.io/projected/22e775fe-4fa5-4c35-9290-87ec14bd689b-kube-api-access-85gkq\") pod \"opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz\" (UID: \"22e775fe-4fa5-4c35-9290-87ec14bd689b\") " pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.348599 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.348573 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:48.480938 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.480771 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz"] Jun 03 00:26:48.483758 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:26:48.483728 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e775fe_4fa5_4c35_9290_87ec14bd689b.slice/crio-16a3ef068adc09ef4b3b406de78fab319adff2548f8ae8554063ed00ad693840 WatchSource:0}: Error finding container 16a3ef068adc09ef4b3b406de78fab319adff2548f8ae8554063ed00ad693840: Status 404 returned error can't find the container with id 16a3ef068adc09ef4b3b406de78fab319adff2548f8ae8554063ed00ad693840 Jun 03 00:26:48.865994 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:48.865955 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" event={"ID":"22e775fe-4fa5-4c35-9290-87ec14bd689b","Type":"ContainerStarted","Data":"16a3ef068adc09ef4b3b406de78fab319adff2548f8ae8554063ed00ad693840"} Jun 03 00:26:51.880660 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:51.880627 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" event={"ID":"22e775fe-4fa5-4c35-9290-87ec14bd689b","Type":"ContainerStarted","Data":"f97e1c4f4a3e67b66b221ce36e4fc9fa83d3fb809f78d19de97450f2bee0949b"} Jun 03 00:26:52.884392 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:52.884360 2574 generic.go:358] "Generic (PLEG): container finished" podID="22e775fe-4fa5-4c35-9290-87ec14bd689b" containerID="f97e1c4f4a3e67b66b221ce36e4fc9fa83d3fb809f78d19de97450f2bee0949b" exitCode=0 Jun 03 00:26:52.884746 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:52.884451 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" event={"ID":"22e775fe-4fa5-4c35-9290-87ec14bd689b","Type":"ContainerDied","Data":"f97e1c4f4a3e67b66b221ce36e4fc9fa83d3fb809f78d19de97450f2bee0949b"} Jun 03 00:26:53.889965 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:53.889923 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" event={"ID":"22e775fe-4fa5-4c35-9290-87ec14bd689b","Type":"ContainerStarted","Data":"e49f1da45b918ba8a9367992d77d512dde6753e8e3eb67827727cd9f5e565b51"} Jun 03 00:26:53.890400 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:53.890035 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:26:53.910422 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:26:53.910368 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" podStartSLOduration=1.157152359 podStartE2EDuration="5.910351816s" podCreationTimestamp="2026-06-03 00:26:48 +0000 UTC" firstStartedPulling="2026-06-03 00:26:48.485591239 +0000 UTC m=+434.573399189" lastFinishedPulling="2026-06-03 00:26:53.238790699 +0000 UTC m=+439.326598646" observedRunningTime="2026-06-03 00:26:53.908655164 +0000 UTC m=+439.996463128" watchObservedRunningTime="2026-06-03 00:26:53.910351816 +0000 UTC m=+439.998159784" Jun 03 00:27:04.895177 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:04.895145 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz" Jun 03 00:27:08.045917 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.045887 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7584859df7-d4hx8"] Jun 03 00:27:08.054075 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.054053 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.057806 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.057780 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 00:27:08.057978 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.057784 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tfmx2\"" Jun 03 00:27:08.058059 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.057842 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7584859df7-d4hx8"] Jun 03 00:27:08.058059 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.057848 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 00:27:08.058172 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.057857 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 00:27:08.058259 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.058242 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 00:27:08.228485 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.228449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7lfq\" (UniqueName: \"kubernetes.io/projected/f4a54541-500f-43ca-a016-b0bfcc2123ac-kube-api-access-v7lfq\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.228654 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.228548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a54541-500f-43ca-a016-b0bfcc2123ac-tls-certs\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.228654 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.228567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4a54541-500f-43ca-a016-b0bfcc2123ac-tmp\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.330022 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.329920 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a54541-500f-43ca-a016-b0bfcc2123ac-tls-certs\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.330022 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.329959 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4a54541-500f-43ca-a016-b0bfcc2123ac-tmp\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.330022 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.330004 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v7lfq\" (UniqueName: \"kubernetes.io/projected/f4a54541-500f-43ca-a016-b0bfcc2123ac-kube-api-access-v7lfq\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.332388 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.332363 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f4a54541-500f-43ca-a016-b0bfcc2123ac-tmp\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.332504 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.332446 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4a54541-500f-43ca-a016-b0bfcc2123ac-tls-certs\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.338058 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.338026 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7lfq\" (UniqueName: \"kubernetes.io/projected/f4a54541-500f-43ca-a016-b0bfcc2123ac-kube-api-access-v7lfq\") pod \"kube-auth-proxy-7584859df7-d4hx8\" (UID: \"f4a54541-500f-43ca-a016-b0bfcc2123ac\") " pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.367325 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.367288 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" Jun 03 00:27:08.514434 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.514399 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7584859df7-d4hx8"] Jun 03 00:27:08.517673 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:27:08.517641 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a54541_500f_43ca_a016_b0bfcc2123ac.slice/crio-6764bc69c25d6add285da49b6d224ea13d3966db82658e9c368fc64e1d95009e WatchSource:0}: Error finding container 6764bc69c25d6add285da49b6d224ea13d3966db82658e9c368fc64e1d95009e: Status 404 returned error can't find the container with id 6764bc69c25d6add285da49b6d224ea13d3966db82658e9c368fc64e1d95009e Jun 03 00:27:08.939675 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:08.939641 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" event={"ID":"f4a54541-500f-43ca-a016-b0bfcc2123ac","Type":"ContainerStarted","Data":"6764bc69c25d6add285da49b6d224ea13d3966db82658e9c368fc64e1d95009e"} Jun 03 00:27:12.954065 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:12.954028 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" event={"ID":"f4a54541-500f-43ca-a016-b0bfcc2123ac","Type":"ContainerStarted","Data":"c9f7612c22abaed8a4daf295f8ef864b34216603b74c443305c93a96596a8561"} Jun 03 00:27:12.971695 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:12.971650 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7584859df7-d4hx8" podStartSLOduration=1.385425828 podStartE2EDuration="4.971637193s" podCreationTimestamp="2026-06-03 00:27:08 +0000 UTC" firstStartedPulling="2026-06-03 00:27:08.51947316 +0000 UTC m=+454.607281107" lastFinishedPulling="2026-06-03 00:27:12.105684514 +0000 UTC m=+458.193492472" observedRunningTime="2026-06-03 00:27:12.970566697 +0000 UTC m=+459.058374662" watchObservedRunningTime="2026-06-03 00:27:12.971637193 +0000 UTC m=+459.059445156" Jun 03 00:27:17.776789 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.776751 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk"] Jun 03 00:27:17.780157 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.780136 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:17.782619 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.782599 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 03 00:27:17.782714 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.782667 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xstn2\"" Jun 03 00:27:17.785477 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.785457 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb"] Jun 03 00:27:17.788732 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.788700 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:17.790788 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.790751 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk"] Jun 03 00:27:17.791487 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.791291 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 03 00:27:17.791487 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.791322 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5zlfh\"" Jun 03 00:27:17.809003 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.808975 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb"] Jun 03 00:27:17.809566 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.809544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjrvr\" (UniqueName: \"kubernetes.io/projected/fd457116-fb1f-44b5-ad97-2f23e2eb6807-kube-api-access-rjrvr\") pod \"kserve-controller-manager-7c99ffcdcd-mvrgk\" (UID: \"fd457116-fb1f-44b5-ad97-2f23e2eb6807\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:17.809667 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.809590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-cert\") pod \"llmisvc-controller-manager-c6b9847d7-4tsgb\" (UID: \"8f4b1b07-daec-4fbb-b907-9bd04bdd421b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:17.809746 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.809722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd457116-fb1f-44b5-ad97-2f23e2eb6807-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mvrgk\" (UID: \"fd457116-fb1f-44b5-ad97-2f23e2eb6807\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:17.809810 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.809767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4v59s\" (UniqueName: \"kubernetes.io/projected/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-kube-api-access-4v59s\") pod \"llmisvc-controller-manager-c6b9847d7-4tsgb\" (UID: \"8f4b1b07-daec-4fbb-b907-9bd04bdd421b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:17.910520 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.910483 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd457116-fb1f-44b5-ad97-2f23e2eb6807-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mvrgk\" (UID: \"fd457116-fb1f-44b5-ad97-2f23e2eb6807\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:17.910724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.910536 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4v59s\" (UniqueName: \"kubernetes.io/projected/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-kube-api-access-4v59s\") pod \"llmisvc-controller-manager-c6b9847d7-4tsgb\" (UID: \"8f4b1b07-daec-4fbb-b907-9bd04bdd421b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:17.910724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.910571 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rjrvr\" (UniqueName: \"kubernetes.io/projected/fd457116-fb1f-44b5-ad97-2f23e2eb6807-kube-api-access-rjrvr\") pod \"kserve-controller-manager-7c99ffcdcd-mvrgk\" (UID: \"fd457116-fb1f-44b5-ad97-2f23e2eb6807\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:17.910724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.910608 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-cert\") pod \"llmisvc-controller-manager-c6b9847d7-4tsgb\" (UID: \"8f4b1b07-daec-4fbb-b907-9bd04bdd421b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:17.910724 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:27:17.910700 2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 03 00:27:17.910934 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:27:17.910759 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-cert podName:8f4b1b07-daec-4fbb-b907-9bd04bdd421b nodeName:}" failed. No retries permitted until 2026-06-03 00:27:18.410739692 +0000 UTC m=+464.498547639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-cert") pod "llmisvc-controller-manager-c6b9847d7-4tsgb" (UID: "8f4b1b07-daec-4fbb-b907-9bd04bdd421b") : secret "llmisvc-webhook-server-cert" not found Jun 03 00:27:17.910934 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:27:17.910910 2574 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 03 00:27:17.911041 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:27:17.910994 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd457116-fb1f-44b5-ad97-2f23e2eb6807-cert podName:fd457116-fb1f-44b5-ad97-2f23e2eb6807 nodeName:}" failed. No retries permitted until 2026-06-03 00:27:18.410946657 +0000 UTC m=+464.498754615 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fd457116-fb1f-44b5-ad97-2f23e2eb6807-cert") pod "kserve-controller-manager-7c99ffcdcd-mvrgk" (UID: "fd457116-fb1f-44b5-ad97-2f23e2eb6807") : secret "kserve-webhook-server-cert" not found Jun 03 00:27:17.922950 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.922916 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4v59s\" (UniqueName: \"kubernetes.io/projected/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-kube-api-access-4v59s\") pod \"llmisvc-controller-manager-c6b9847d7-4tsgb\" (UID: \"8f4b1b07-daec-4fbb-b907-9bd04bdd421b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:17.923878 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:17.923860 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjrvr\" (UniqueName: \"kubernetes.io/projected/fd457116-fb1f-44b5-ad97-2f23e2eb6807-kube-api-access-rjrvr\") pod \"kserve-controller-manager-7c99ffcdcd-mvrgk\" (UID: \"fd457116-fb1f-44b5-ad97-2f23e2eb6807\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:18.415409 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.415370 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd457116-fb1f-44b5-ad97-2f23e2eb6807-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mvrgk\" (UID: \"fd457116-fb1f-44b5-ad97-2f23e2eb6807\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:18.415620 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.415427 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-cert\") pod \"llmisvc-controller-manager-c6b9847d7-4tsgb\" (UID: \"8f4b1b07-daec-4fbb-b907-9bd04bdd421b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:18.417808 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.417774 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8f4b1b07-daec-4fbb-b907-9bd04bdd421b-cert\") pod \"llmisvc-controller-manager-c6b9847d7-4tsgb\" (UID: \"8f4b1b07-daec-4fbb-b907-9bd04bdd421b\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:18.417922 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.417820 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd457116-fb1f-44b5-ad97-2f23e2eb6807-cert\") pod \"kserve-controller-manager-7c99ffcdcd-mvrgk\" (UID: \"fd457116-fb1f-44b5-ad97-2f23e2eb6807\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:18.692258 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.692169 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:18.701003 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.700971 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:18.846663 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.846638 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk"] Jun 03 00:27:18.848468 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:27:18.848437 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd457116_fb1f_44b5_ad97_2f23e2eb6807.slice/crio-ab7f8c7f1cc972cb3647700fe683f9a7518f563e6457ed1a355e57c6422b9554 WatchSource:0}: Error finding container ab7f8c7f1cc972cb3647700fe683f9a7518f563e6457ed1a355e57c6422b9554: Status 404 returned error can't find the container with id ab7f8c7f1cc972cb3647700fe683f9a7518f563e6457ed1a355e57c6422b9554 Jun 03 00:27:18.863078 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.863049 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb"] Jun 03 00:27:18.865808 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:27:18.865783 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8f4b1b07_daec_4fbb_b907_9bd04bdd421b.slice/crio-40e9dee84748162e589caf9bfbeb80c4dc32165bc68e98171f31be30b40292f6 WatchSource:0}: Error finding container 40e9dee84748162e589caf9bfbeb80c4dc32165bc68e98171f31be30b40292f6: Status 404 returned error can't find the container with id 40e9dee84748162e589caf9bfbeb80c4dc32165bc68e98171f31be30b40292f6 Jun 03 00:27:18.975781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.975699 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" event={"ID":"8f4b1b07-daec-4fbb-b907-9bd04bdd421b","Type":"ContainerStarted","Data":"40e9dee84748162e589caf9bfbeb80c4dc32165bc68e98171f31be30b40292f6"} Jun 03 00:27:18.976772 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:18.976743 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" event={"ID":"fd457116-fb1f-44b5-ad97-2f23e2eb6807","Type":"ContainerStarted","Data":"ab7f8c7f1cc972cb3647700fe683f9a7518f563e6457ed1a355e57c6422b9554"} Jun 03 00:27:21.989393 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:21.989356 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" event={"ID":"fd457116-fb1f-44b5-ad97-2f23e2eb6807","Type":"ContainerStarted","Data":"d678780b20113455627d2e2a0f884b692ab1f8af00ba07c187022e878ec7101a"} Jun 03 00:27:21.989769 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:21.989498 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:22.006640 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:22.006588 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" podStartSLOduration=2.082777131 podStartE2EDuration="5.006570035s" podCreationTimestamp="2026-06-03 00:27:17 +0000 UTC" firstStartedPulling="2026-06-03 00:27:18.849750766 +0000 UTC m=+464.937558713" lastFinishedPulling="2026-06-03 00:27:21.773543673 +0000 UTC m=+467.861351617" observedRunningTime="2026-06-03 00:27:22.004671575 +0000 UTC m=+468.092479543" watchObservedRunningTime="2026-06-03 00:27:22.006570035 +0000 UTC m=+468.094378001" Jun 03 00:27:22.994486 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:22.994398 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" event={"ID":"8f4b1b07-daec-4fbb-b907-9bd04bdd421b","Type":"ContainerStarted","Data":"1e362da634cb434610448da3859f85a9a4245cdd926b047f151c1d5f2ab69376"} Jun 03 00:27:22.994883 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:22.994708 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:27:23.009930 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:23.009888 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" podStartSLOduration=2.229814784 podStartE2EDuration="6.00987465s" podCreationTimestamp="2026-06-03 00:27:17 +0000 UTC" firstStartedPulling="2026-06-03 00:27:18.86700239 +0000 UTC m=+464.954810333" lastFinishedPulling="2026-06-03 00:27:22.647062256 +0000 UTC m=+468.734870199" observedRunningTime="2026-06-03 00:27:23.008738618 +0000 UTC m=+469.096546584" watchObservedRunningTime="2026-06-03 00:27:23.00987465 +0000 UTC m=+469.097682641" Jun 03 00:27:27.362047 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.362014 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q"] Jun 03 00:27:27.371843 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.371818 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:27.374455 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.374433 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 03 00:27:27.374574 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.374432 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-hgkjx\"" Jun 03 00:27:27.374574 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.374467 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 03 00:27:27.378639 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.378616 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q"] Jun 03 00:27:27.398355 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.398325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn4b2\" (UniqueName: \"kubernetes.io/projected/20361ead-99d4-41fc-ad09-675f2ce212c1-kube-api-access-gn4b2\") pod \"servicemesh-operator3-55f49c5f94-9jm8q\" (UID: \"20361ead-99d4-41fc-ad09-675f2ce212c1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:27.398484 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.398375 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/20361ead-99d4-41fc-ad09-675f2ce212c1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9jm8q\" (UID: \"20361ead-99d4-41fc-ad09-675f2ce212c1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:27.499741 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.499711 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gn4b2\" (UniqueName: \"kubernetes.io/projected/20361ead-99d4-41fc-ad09-675f2ce212c1-kube-api-access-gn4b2\") pod \"servicemesh-operator3-55f49c5f94-9jm8q\" (UID: \"20361ead-99d4-41fc-ad09-675f2ce212c1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:27.499855 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.499769 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/20361ead-99d4-41fc-ad09-675f2ce212c1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9jm8q\" (UID: \"20361ead-99d4-41fc-ad09-675f2ce212c1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:27.502262 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.502240 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/20361ead-99d4-41fc-ad09-675f2ce212c1-operator-config\") pod \"servicemesh-operator3-55f49c5f94-9jm8q\" (UID: \"20361ead-99d4-41fc-ad09-675f2ce212c1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:27.508239 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.508218 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn4b2\" (UniqueName: \"kubernetes.io/projected/20361ead-99d4-41fc-ad09-675f2ce212c1-kube-api-access-gn4b2\") pod \"servicemesh-operator3-55f49c5f94-9jm8q\" (UID: \"20361ead-99d4-41fc-ad09-675f2ce212c1\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:27.681662 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.681583 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:27.811217 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:27.811175 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q"] Jun 03 00:27:27.813802 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:27:27.813774 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20361ead_99d4_41fc_ad09_675f2ce212c1.slice/crio-d422a8531df4b83ab3d0d7ec1ff565555668a479135b18f63740c8fb8ce4c60d WatchSource:0}: Error finding container d422a8531df4b83ab3d0d7ec1ff565555668a479135b18f63740c8fb8ce4c60d: Status 404 returned error can't find the container with id d422a8531df4b83ab3d0d7ec1ff565555668a479135b18f63740c8fb8ce4c60d Jun 03 00:27:28.018445 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:28.018356 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" event={"ID":"20361ead-99d4-41fc-ad09-675f2ce212c1","Type":"ContainerStarted","Data":"d422a8531df4b83ab3d0d7ec1ff565555668a479135b18f63740c8fb8ce4c60d"} Jun 03 00:27:31.030652 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:31.030613 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" event={"ID":"20361ead-99d4-41fc-ad09-675f2ce212c1","Type":"ContainerStarted","Data":"31df39b78fa52e70c9f6d608cfd3acb0ba22881b480af554ba729586e972a766"} Jun 03 00:27:31.031050 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:31.030897 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:31.052875 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:31.052813 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" podStartSLOduration=1.3743510030000001 podStartE2EDuration="4.052797127s" podCreationTimestamp="2026-06-03 00:27:27 +0000 UTC" firstStartedPulling="2026-06-03 00:27:27.816243054 +0000 UTC m=+473.904051003" lastFinishedPulling="2026-06-03 00:27:30.494689184 +0000 UTC m=+476.582497127" observedRunningTime="2026-06-03 00:27:31.050263675 +0000 UTC m=+477.138071642" watchObservedRunningTime="2026-06-03 00:27:31.052797127 +0000 UTC m=+477.140605093" Jun 03 00:27:42.036178 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:42.036146 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-9jm8q" Jun 03 00:27:43.064446 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.064407 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx"] Jun 03 00:27:43.073097 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.073078 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.075624 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.075600 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 03 00:27:43.075730 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.075656 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 03 00:27:43.075902 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.075887 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 03 00:27:43.076111 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.076094 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 03 00:27:43.076186 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.076169 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zj5vs\"" Jun 03 00:27:43.080583 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.080559 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx"] Jun 03 00:27:43.134803 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.134773 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/234d422b-5977-4b4c-a0a0-5f95790ccaf4-local-certs\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.134803 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.134804 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-token\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.134988 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.134845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j9sz\" (UniqueName: \"kubernetes.io/projected/234d422b-5977-4b4c-a0a0-5f95790ccaf4-kube-api-access-4j9sz\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.134988 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.134887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.134988 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.134933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-cacerts\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.134988 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.134956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.134988 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.134983 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.235520 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.235487 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-cacerts\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.235520 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.235526 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.235754 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.235559 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.235754 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.235601 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/234d422b-5977-4b4c-a0a0-5f95790ccaf4-local-certs\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.235754 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.235623 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-token\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.235754 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.235720 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4j9sz\" (UniqueName: \"kubernetes.io/projected/234d422b-5977-4b4c-a0a0-5f95790ccaf4-kube-api-access-4j9sz\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.235962 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.235788 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.236264 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.236236 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.238176 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.238127 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-cacerts\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.238389 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.238323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.238389 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.238324 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/234d422b-5977-4b4c-a0a0-5f95790ccaf4-local-certs\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.238550 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.238513 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.252429 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.252405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j9sz\" (UniqueName: \"kubernetes.io/projected/234d422b-5977-4b4c-a0a0-5f95790ccaf4-kube-api-access-4j9sz\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.255031 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.255008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/234d422b-5977-4b4c-a0a0-5f95790ccaf4-istio-token\") pod \"istiod-openshift-gateway-798958bb55-wb2gx\" (UID: \"234d422b-5977-4b4c-a0a0-5f95790ccaf4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.384070 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.384031 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:43.530818 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.530785 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx"] Jun 03 00:27:43.533456 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:27:43.533422 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234d422b_5977_4b4c_a0a0_5f95790ccaf4.slice/crio-736561f48dfc3d88eee1f7029bf2326183118b433246cfe177e17a1c5b477810 WatchSource:0}: Error finding container 736561f48dfc3d88eee1f7029bf2326183118b433246cfe177e17a1c5b477810: Status 404 returned error can't find the container with id 736561f48dfc3d88eee1f7029bf2326183118b433246cfe177e17a1c5b477810 Jun 03 00:27:43.876397 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.876365 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-767d585f79-jgqdw"] Jun 03 00:27:43.881724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.881700 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" Jun 03 00:27:43.887136 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.886372 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 03 00:27:43.887136 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.886664 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-snq46\"" Jun 03 00:27:43.892646 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.890937 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-767d585f79-jgqdw"] Jun 03 00:27:43.941551 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.941517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a090a75f-4016-4347-af7e-1a451f9e9373-redirect-config\") pod \"dashboard-redirect-767d585f79-jgqdw\" (UID: \"a090a75f-4016-4347-af7e-1a451f9e9373\") " pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" Jun 03 00:27:43.941731 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:43.941626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2f6r\" (UniqueName: \"kubernetes.io/projected/a090a75f-4016-4347-af7e-1a451f9e9373-kube-api-access-s2f6r\") pod \"dashboard-redirect-767d585f79-jgqdw\" (UID: \"a090a75f-4016-4347-af7e-1a451f9e9373\") " pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" Jun 03 00:27:44.042984 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:44.042937 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2f6r\" (UniqueName: \"kubernetes.io/projected/a090a75f-4016-4347-af7e-1a451f9e9373-kube-api-access-s2f6r\") pod \"dashboard-redirect-767d585f79-jgqdw\" (UID: \"a090a75f-4016-4347-af7e-1a451f9e9373\") " pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" Jun 03 00:27:44.042984 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:44.042987 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a090a75f-4016-4347-af7e-1a451f9e9373-redirect-config\") pod \"dashboard-redirect-767d585f79-jgqdw\" (UID: \"a090a75f-4016-4347-af7e-1a451f9e9373\") " pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" Jun 03 00:27:44.043721 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:44.043701 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a090a75f-4016-4347-af7e-1a451f9e9373-redirect-config\") pod \"dashboard-redirect-767d585f79-jgqdw\" (UID: \"a090a75f-4016-4347-af7e-1a451f9e9373\") " pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" Jun 03 00:27:44.051648 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:44.051620 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2f6r\" (UniqueName: \"kubernetes.io/projected/a090a75f-4016-4347-af7e-1a451f9e9373-kube-api-access-s2f6r\") pod \"dashboard-redirect-767d585f79-jgqdw\" (UID: \"a090a75f-4016-4347-af7e-1a451f9e9373\") " pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" Jun 03 00:27:44.073136 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:44.073100 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" event={"ID":"234d422b-5977-4b4c-a0a0-5f95790ccaf4","Type":"ContainerStarted","Data":"736561f48dfc3d88eee1f7029bf2326183118b433246cfe177e17a1c5b477810"} Jun 03 00:27:44.200830 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:44.200755 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" Jun 03 00:27:44.328610 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:44.328585 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-767d585f79-jgqdw"] Jun 03 00:27:44.331728 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:27:44.331690 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda090a75f_4016_4347_af7e_1a451f9e9373.slice/crio-667f3e5e92b1f8175d4e3d1375177bad040c0ab3bc8259ca31672dd3f5aafdbf WatchSource:0}: Error finding container 667f3e5e92b1f8175d4e3d1375177bad040c0ab3bc8259ca31672dd3f5aafdbf: Status 404 returned error can't find the container with id 667f3e5e92b1f8175d4e3d1375177bad040c0ab3bc8259ca31672dd3f5aafdbf Jun 03 00:27:45.078062 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:45.078026 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" event={"ID":"a090a75f-4016-4347-af7e-1a451f9e9373","Type":"ContainerStarted","Data":"667f3e5e92b1f8175d4e3d1375177bad040c0ab3bc8259ca31672dd3f5aafdbf"} Jun 03 00:27:47.038964 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:47.038921 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 00:27:47.039240 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:47.038993 2574 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 03 00:27:48.090856 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:48.090815 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" event={"ID":"a090a75f-4016-4347-af7e-1a451f9e9373","Type":"ContainerStarted","Data":"fb9c1033527bc16c804376def0439bd1220c355d43b7bb5224280bfac7ef7734"} Jun 03 00:27:48.092316 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:48.092290 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" event={"ID":"234d422b-5977-4b4c-a0a0-5f95790ccaf4","Type":"ContainerStarted","Data":"e4827fdc132386116d8b27896d6dafb1a1b0dc650af50c26c549a965e171fb8e"} Jun 03 00:27:48.092456 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:48.092437 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:48.093935 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:48.093913 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-798958bb55-wb2gx container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 03 00:27:48.094036 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:48.093964 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" podUID="234d422b-5977-4b4c-a0a0-5f95790ccaf4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 00:27:48.141828 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:48.141745 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-767d585f79-jgqdw" podStartSLOduration=2.340003422 podStartE2EDuration="5.141729227s" podCreationTimestamp="2026-06-03 00:27:43 +0000 UTC" firstStartedPulling="2026-06-03 00:27:44.333508325 +0000 UTC m=+490.421316268" lastFinishedPulling="2026-06-03 00:27:47.13523412 +0000 UTC m=+493.223042073" observedRunningTime="2026-06-03 00:27:48.119267506 +0000 UTC m=+494.207075473" watchObservedRunningTime="2026-06-03 00:27:48.141729227 +0000 UTC m=+494.229537191" Jun 03 00:27:48.142944 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:48.142866 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" podStartSLOduration=1.639563256 podStartE2EDuration="5.142851112s" podCreationTimestamp="2026-06-03 00:27:43 +0000 UTC" firstStartedPulling="2026-06-03 00:27:43.535373384 +0000 UTC m=+489.623181327" lastFinishedPulling="2026-06-03 00:27:47.038661239 +0000 UTC m=+493.126469183" observedRunningTime="2026-06-03 00:27:48.141443318 +0000 UTC m=+494.229251282" watchObservedRunningTime="2026-06-03 00:27:48.142851112 +0000 UTC m=+494.230659089" Jun 03 00:27:49.096526 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:49.096493 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-wb2gx" Jun 03 00:27:52.999815 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:52.999775 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-mvrgk" Jun 03 00:27:55.004207 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:27:55.004162 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-4tsgb" Jun 03 00:28:52.647950 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.647912 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-5hvlc"] Jun 03 00:28:52.651482 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.651460 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" Jun 03 00:28:52.654063 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.654040 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 00:28:52.654994 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.654981 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 00:28:52.655343 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.654994 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-gxgs2\"" Jun 03 00:28:52.659457 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.659434 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-5hvlc"] Jun 03 00:28:52.811592 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.811548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr67n\" (UniqueName: \"kubernetes.io/projected/0e10de48-4396-451e-9edb-2046a3e8d122-kube-api-access-cr67n\") pod \"authorino-operator-657f44b778-5hvlc\" (UID: \"0e10de48-4396-451e-9edb-2046a3e8d122\") " pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" Jun 03 00:28:52.912674 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.912575 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cr67n\" (UniqueName: \"kubernetes.io/projected/0e10de48-4396-451e-9edb-2046a3e8d122-kube-api-access-cr67n\") pod \"authorino-operator-657f44b778-5hvlc\" (UID: \"0e10de48-4396-451e-9edb-2046a3e8d122\") " pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" Jun 03 00:28:52.921367 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.921344 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr67n\" (UniqueName: \"kubernetes.io/projected/0e10de48-4396-451e-9edb-2046a3e8d122-kube-api-access-cr67n\") pod \"authorino-operator-657f44b778-5hvlc\" (UID: \"0e10de48-4396-451e-9edb-2046a3e8d122\") " pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" Jun 03 00:28:52.962920 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:52.962891 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" Jun 03 00:28:53.092786 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:53.092762 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-5hvlc"] Jun 03 00:28:53.095375 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:28:53.095347 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e10de48_4396_451e_9edb_2046a3e8d122.slice/crio-a589a8cbfc5e2505b6f4d4683d2c7f43c84f401c582892c73df0596bffbeca58 WatchSource:0}: Error finding container a589a8cbfc5e2505b6f4d4683d2c7f43c84f401c582892c73df0596bffbeca58: Status 404 returned error can't find the container with id a589a8cbfc5e2505b6f4d4683d2c7f43c84f401c582892c73df0596bffbeca58 Jun 03 00:28:53.300505 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:53.300425 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" event={"ID":"0e10de48-4396-451e-9edb-2046a3e8d122","Type":"ContainerStarted","Data":"a589a8cbfc5e2505b6f4d4683d2c7f43c84f401c582892c73df0596bffbeca58"} Jun 03 00:28:56.316568 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:56.316534 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" event={"ID":"0e10de48-4396-451e-9edb-2046a3e8d122","Type":"ContainerStarted","Data":"9b4b653cc295851b362f0bafadeaab2cab085ddbd68a0a65bad64b52aae16c6f"} Jun 03 00:28:56.316973 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:56.316593 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" Jun 03 00:28:56.332996 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:28:56.332954 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" podStartSLOduration=1.638105861 podStartE2EDuration="4.332939389s" podCreationTimestamp="2026-06-03 00:28:52 +0000 UTC" firstStartedPulling="2026-06-03 00:28:53.097321685 +0000 UTC m=+559.185129628" lastFinishedPulling="2026-06-03 00:28:55.792155213 +0000 UTC m=+561.879963156" observedRunningTime="2026-06-03 00:28:56.331774314 +0000 UTC m=+562.419582280" watchObservedRunningTime="2026-06-03 00:28:56.332939389 +0000 UTC m=+562.420747398" Jun 03 00:29:07.322752 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:07.322715 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-5hvlc" Jun 03 00:29:34.519468 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:34.519444 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:29:34.520656 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:34.520635 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:29:38.850122 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:38.850094 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-r6f9m"] Jun 03 00:29:38.853395 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:38.853378 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:38.855867 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:38.855845 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l8tjj\"" Jun 03 00:29:38.855963 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:38.855850 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 00:29:38.858908 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:38.858885 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-r6f9m"] Jun 03 00:29:38.953695 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:38.953665 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-r6f9m"] Jun 03 00:29:39.002237 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.002188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b26beed2-7e1a-4506-9986-0bd8283e1d50-config-file\") pod \"limitador-limitador-7d549b5b-r6f9m\" (UID: \"b26beed2-7e1a-4506-9986-0bd8283e1d50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:39.002387 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.002253 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5sj\" (UniqueName: \"kubernetes.io/projected/b26beed2-7e1a-4506-9986-0bd8283e1d50-kube-api-access-vq5sj\") pod \"limitador-limitador-7d549b5b-r6f9m\" (UID: \"b26beed2-7e1a-4506-9986-0bd8283e1d50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:39.103407 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.103315 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b26beed2-7e1a-4506-9986-0bd8283e1d50-config-file\") pod \"limitador-limitador-7d549b5b-r6f9m\" (UID: \"b26beed2-7e1a-4506-9986-0bd8283e1d50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:39.103407 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.103372 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5sj\" (UniqueName: \"kubernetes.io/projected/b26beed2-7e1a-4506-9986-0bd8283e1d50-kube-api-access-vq5sj\") pod \"limitador-limitador-7d549b5b-r6f9m\" (UID: \"b26beed2-7e1a-4506-9986-0bd8283e1d50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:39.103918 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.103897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b26beed2-7e1a-4506-9986-0bd8283e1d50-config-file\") pod \"limitador-limitador-7d549b5b-r6f9m\" (UID: \"b26beed2-7e1a-4506-9986-0bd8283e1d50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:39.111236 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.111209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5sj\" (UniqueName: \"kubernetes.io/projected/b26beed2-7e1a-4506-9986-0bd8283e1d50-kube-api-access-vq5sj\") pod \"limitador-limitador-7d549b5b-r6f9m\" (UID: \"b26beed2-7e1a-4506-9986-0bd8283e1d50\") " pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:39.164547 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.164511 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:39.289806 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.289770 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-r6f9m"] Jun 03 00:29:39.292636 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:29:39.292604 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb26beed2_7e1a_4506_9986_0bd8283e1d50.slice/crio-9afaea74f3d8dc0beaaff4160c42e808a859cd8141208c02be15c49003ea378a WatchSource:0}: Error finding container 9afaea74f3d8dc0beaaff4160c42e808a859cd8141208c02be15c49003ea378a: Status 404 returned error can't find the container with id 9afaea74f3d8dc0beaaff4160c42e808a859cd8141208c02be15c49003ea378a Jun 03 00:29:39.472309 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:39.472232 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" event={"ID":"b26beed2-7e1a-4506-9986-0bd8283e1d50","Type":"ContainerStarted","Data":"9afaea74f3d8dc0beaaff4160c42e808a859cd8141208c02be15c49003ea378a"} Jun 03 00:29:43.489457 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:43.489425 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" event={"ID":"b26beed2-7e1a-4506-9986-0bd8283e1d50","Type":"ContainerStarted","Data":"de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e"} Jun 03 00:29:43.489872 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:43.489587 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:43.505036 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:43.504988 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" podStartSLOduration=2.153334114 podStartE2EDuration="5.504973936s" podCreationTimestamp="2026-06-03 00:29:38 +0000 UTC" firstStartedPulling="2026-06-03 00:29:39.294377366 +0000 UTC m=+605.382185309" lastFinishedPulling="2026-06-03 00:29:42.646017185 +0000 UTC m=+608.733825131" observedRunningTime="2026-06-03 00:29:43.504183581 +0000 UTC m=+609.591991548" watchObservedRunningTime="2026-06-03 00:29:43.504973936 +0000 UTC m=+609.592781904" Jun 03 00:29:54.493731 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:54.493653 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:56.517753 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:56.517720 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-r6f9m"] Jun 03 00:29:56.518165 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:56.517926 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" podUID="b26beed2-7e1a-4506-9986-0bd8283e1d50" containerName="limitador" containerID="cri-o://de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e" gracePeriod=30 Jun 03 00:29:57.054610 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.054583 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:57.159054 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.159021 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq5sj\" (UniqueName: \"kubernetes.io/projected/b26beed2-7e1a-4506-9986-0bd8283e1d50-kube-api-access-vq5sj\") pod \"b26beed2-7e1a-4506-9986-0bd8283e1d50\" (UID: \"b26beed2-7e1a-4506-9986-0bd8283e1d50\") " Jun 03 00:29:57.159218 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.159094 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b26beed2-7e1a-4506-9986-0bd8283e1d50-config-file\") pod \"b26beed2-7e1a-4506-9986-0bd8283e1d50\" (UID: \"b26beed2-7e1a-4506-9986-0bd8283e1d50\") " Jun 03 00:29:57.159493 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.159466 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b26beed2-7e1a-4506-9986-0bd8283e1d50-config-file" (OuterVolumeSpecName: "config-file") pod "b26beed2-7e1a-4506-9986-0bd8283e1d50" (UID: "b26beed2-7e1a-4506-9986-0bd8283e1d50"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 00:29:57.161178 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.161159 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b26beed2-7e1a-4506-9986-0bd8283e1d50-kube-api-access-vq5sj" (OuterVolumeSpecName: "kube-api-access-vq5sj") pod "b26beed2-7e1a-4506-9986-0bd8283e1d50" (UID: "b26beed2-7e1a-4506-9986-0bd8283e1d50"). InnerVolumeSpecName "kube-api-access-vq5sj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:29:57.260526 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.260489 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b26beed2-7e1a-4506-9986-0bd8283e1d50-config-file\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:29:57.260526 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.260522 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq5sj\" (UniqueName: \"kubernetes.io/projected/b26beed2-7e1a-4506-9986-0bd8283e1d50-kube-api-access-vq5sj\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:29:57.535426 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.535335 2574 generic.go:358] "Generic (PLEG): container finished" podID="b26beed2-7e1a-4506-9986-0bd8283e1d50" containerID="de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e" exitCode=0 Jun 03 00:29:57.535426 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.535395 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" Jun 03 00:29:57.535426 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.535412 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" event={"ID":"b26beed2-7e1a-4506-9986-0bd8283e1d50","Type":"ContainerDied","Data":"de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e"} Jun 03 00:29:57.535952 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.535446 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-r6f9m" event={"ID":"b26beed2-7e1a-4506-9986-0bd8283e1d50","Type":"ContainerDied","Data":"9afaea74f3d8dc0beaaff4160c42e808a859cd8141208c02be15c49003ea378a"} Jun 03 00:29:57.535952 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.535460 2574 scope.go:117] "RemoveContainer" containerID="de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e" Jun 03 00:29:57.543161 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.543139 2574 scope.go:117] "RemoveContainer" containerID="de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e" Jun 03 00:29:57.543423 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:29:57.543403 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e\": container with ID starting with de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e not found: ID does not exist" containerID="de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e" Jun 03 00:29:57.543487 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.543434 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e"} err="failed to get container status \"de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e\": rpc error: code = NotFound desc = could not find container \"de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e\": container with ID starting with de84db8ab952f001d4cdb478e2179550361cb6b23b93bacaa6bfab65334a6f1e not found: ID does not exist" Jun 03 00:29:57.555261 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.555240 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-r6f9m"] Jun 03 00:29:57.559951 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:57.559930 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-r6f9m"] Jun 03 00:29:58.622774 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:29:58.622738 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b26beed2-7e1a-4506-9986-0bd8283e1d50" path="/var/lib/kubelet/pods/b26beed2-7e1a-4506-9986-0bd8283e1d50/volumes" Jun 03 00:30:00.032019 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.031985 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-gsnj6"] Jun 03 00:30:00.032503 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.032374 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b26beed2-7e1a-4506-9986-0bd8283e1d50" containerName="limitador" Jun 03 00:30:00.032503 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.032387 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="b26beed2-7e1a-4506-9986-0bd8283e1d50" containerName="limitador" Jun 03 00:30:00.032503 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.032463 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="b26beed2-7e1a-4506-9986-0bd8283e1d50" containerName="limitador" Jun 03 00:30:00.037218 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.037175 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:00.039716 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.039693 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 00:30:00.042345 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.042304 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-gsnj6"] Jun 03 00:30:00.080901 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.080866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a8a5119-4a3f-4e8e-87f6-e963362d1266-data\") pod \"postgres-68c4fbbd6f-gsnj6\" (UID: \"9a8a5119-4a3f-4e8e-87f6-e963362d1266\") " pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:00.081032 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.080928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-224tr\" (UniqueName: \"kubernetes.io/projected/9a8a5119-4a3f-4e8e-87f6-e963362d1266-kube-api-access-224tr\") pod \"postgres-68c4fbbd6f-gsnj6\" (UID: \"9a8a5119-4a3f-4e8e-87f6-e963362d1266\") " pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:00.181970 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.181936 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-224tr\" (UniqueName: \"kubernetes.io/projected/9a8a5119-4a3f-4e8e-87f6-e963362d1266-kube-api-access-224tr\") pod \"postgres-68c4fbbd6f-gsnj6\" (UID: \"9a8a5119-4a3f-4e8e-87f6-e963362d1266\") " pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:00.182119 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.182018 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a8a5119-4a3f-4e8e-87f6-e963362d1266-data\") pod \"postgres-68c4fbbd6f-gsnj6\" (UID: \"9a8a5119-4a3f-4e8e-87f6-e963362d1266\") " pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:00.182402 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.182383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9a8a5119-4a3f-4e8e-87f6-e963362d1266-data\") pod \"postgres-68c4fbbd6f-gsnj6\" (UID: \"9a8a5119-4a3f-4e8e-87f6-e963362d1266\") " pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:00.189863 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.189839 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-224tr\" (UniqueName: \"kubernetes.io/projected/9a8a5119-4a3f-4e8e-87f6-e963362d1266-kube-api-access-224tr\") pod \"postgres-68c4fbbd6f-gsnj6\" (UID: \"9a8a5119-4a3f-4e8e-87f6-e963362d1266\") " pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:00.351531 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.351504 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:00.474072 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.474049 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-gsnj6"] Jun 03 00:30:00.476949 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:30:00.476920 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a8a5119_4a3f_4e8e_87f6_e963362d1266.slice/crio-ab1e06e2f34f2246b2668e014c8de643de7ee9b2c076bc64c1da84b0944ef805 WatchSource:0}: Error finding container ab1e06e2f34f2246b2668e014c8de643de7ee9b2c076bc64c1da84b0944ef805: Status 404 returned error can't find the container with id ab1e06e2f34f2246b2668e014c8de643de7ee9b2c076bc64c1da84b0944ef805 Jun 03 00:30:00.547361 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:00.547319 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-gsnj6" event={"ID":"9a8a5119-4a3f-4e8e-87f6-e963362d1266","Type":"ContainerStarted","Data":"ab1e06e2f34f2246b2668e014c8de643de7ee9b2c076bc64c1da84b0944ef805"} Jun 03 00:30:03.558559 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:03.558516 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-gsnj6" event={"ID":"9a8a5119-4a3f-4e8e-87f6-e963362d1266","Type":"ContainerStarted","Data":"1118d50ccaf3347a7520eb17a0c9dcd3a462d59441d98d757d63e2aa824fab2d"} Jun 03 00:30:03.558933 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:03.558693 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:03.574283 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:03.574229 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-gsnj6" podStartSLOduration=1.08657466 podStartE2EDuration="3.574184844s" podCreationTimestamp="2026-06-03 00:30:00 +0000 UTC" firstStartedPulling="2026-06-03 00:30:00.47837875 +0000 UTC m=+626.566186692" lastFinishedPulling="2026-06-03 00:30:02.965988915 +0000 UTC m=+629.053796876" observedRunningTime="2026-06-03 00:30:03.572502543 +0000 UTC m=+629.660310507" watchObservedRunningTime="2026-06-03 00:30:03.574184844 +0000 UTC m=+629.661992810" Jun 03 00:30:09.592834 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:09.592805 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-gsnj6" Jun 03 00:30:33.238023 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.237989 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:30:33.241151 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.241135 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 00:30:33.243477 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.243451 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 00:30:33.243599 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.243497 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 00:30:33.243599 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.243582 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 00:30:33.244531 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.244513 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-pk5xd\"" Jun 03 00:30:33.253609 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.251384 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:30:33.352015 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.351972 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdxwm\" (UniqueName: \"kubernetes.io/projected/26940ded-5d45-4ef2-976e-91fddf5ac3e9-kube-api-access-pdxwm\") pod \"maas-keycloak-0\" (UID: \"26940ded-5d45-4ef2-976e-91fddf5ac3e9\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:30:33.452547 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.452511 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pdxwm\" (UniqueName: \"kubernetes.io/projected/26940ded-5d45-4ef2-976e-91fddf5ac3e9-kube-api-access-pdxwm\") pod \"maas-keycloak-0\" (UID: \"26940ded-5d45-4ef2-976e-91fddf5ac3e9\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:30:33.460447 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.460420 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdxwm\" (UniqueName: \"kubernetes.io/projected/26940ded-5d45-4ef2-976e-91fddf5ac3e9-kube-api-access-pdxwm\") pod \"maas-keycloak-0\" (UID: \"26940ded-5d45-4ef2-976e-91fddf5ac3e9\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:30:33.557241 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.557127 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 00:30:33.683781 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:33.683751 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:30:33.686989 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:30:33.686956 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26940ded_5d45_4ef2_976e_91fddf5ac3e9.slice/crio-8d31a501736e0f234b35cd52d52e77acccc197eb3097949b559a817dd9c09232 WatchSource:0}: Error finding container 8d31a501736e0f234b35cd52d52e77acccc197eb3097949b559a817dd9c09232: Status 404 returned error can't find the container with id 8d31a501736e0f234b35cd52d52e77acccc197eb3097949b559a817dd9c09232 Jun 03 00:30:34.666281 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:34.666237 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"26940ded-5d45-4ef2-976e-91fddf5ac3e9","Type":"ContainerStarted","Data":"8d31a501736e0f234b35cd52d52e77acccc197eb3097949b559a817dd9c09232"} Jun 03 00:30:38.284326 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:38.284303 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 00:30:38.683437 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:38.683393 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"26940ded-5d45-4ef2-976e-91fddf5ac3e9","Type":"ContainerStarted","Data":"c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87"} Jun 03 00:30:38.700168 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:38.700114 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.106848141 podStartE2EDuration="5.70010085s" podCreationTimestamp="2026-06-03 00:30:33 +0000 UTC" firstStartedPulling="2026-06-03 00:30:33.688296878 +0000 UTC m=+659.776104825" lastFinishedPulling="2026-06-03 00:30:38.281549579 +0000 UTC m=+664.369357534" observedRunningTime="2026-06-03 00:30:38.69851824 +0000 UTC m=+664.786326218" watchObservedRunningTime="2026-06-03 00:30:38.70010085 +0000 UTC m=+664.787908815" Jun 03 00:30:39.557914 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:39.557876 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 00:30:39.559339 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:39.559307 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:40.558027 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:40.557977 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:41.558344 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:41.558293 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:42.557758 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:42.557701 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:43.557760 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:43.557713 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 00:30:43.559059 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:43.558142 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:44.558146 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:44.558086 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:45.558230 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:45.558160 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:46.558541 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:46.558483 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:47.557745 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:47.557684 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:48.558145 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:48.558092 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:49.557828 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:49.557789 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:50.557832 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:50.557794 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.29:9000/health/started\": dial tcp 10.132.0.29:9000: connect: connection refused" Jun 03 00:30:51.685351 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:51.685319 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 00:30:51.703962 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:30:51.703906 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 00:31:01.692137 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:01.692096 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:54.798573 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:54.798538 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:31:54.799083 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:54.798765 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" containerID="cri-o://c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87" gracePeriod=30 Jun 03 00:31:56.834381 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.834359 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:56.870445 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.870418 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdxwm\" (UniqueName: \"kubernetes.io/projected/26940ded-5d45-4ef2-976e-91fddf5ac3e9-kube-api-access-pdxwm\") pod \"26940ded-5d45-4ef2-976e-91fddf5ac3e9\" (UID: \"26940ded-5d45-4ef2-976e-91fddf5ac3e9\") " Jun 03 00:31:56.872512 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.872485 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26940ded-5d45-4ef2-976e-91fddf5ac3e9-kube-api-access-pdxwm" (OuterVolumeSpecName: "kube-api-access-pdxwm") pod "26940ded-5d45-4ef2-976e-91fddf5ac3e9" (UID: "26940ded-5d45-4ef2-976e-91fddf5ac3e9"). InnerVolumeSpecName "kube-api-access-pdxwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 00:31:56.967689 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.967615 2574 generic.go:358] "Generic (PLEG): container finished" podID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerID="c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87" exitCode=143 Jun 03 00:31:56.967689 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.967678 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:56.967909 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.967687 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"26940ded-5d45-4ef2-976e-91fddf5ac3e9","Type":"ContainerDied","Data":"c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87"} Jun 03 00:31:56.967909 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.967714 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"26940ded-5d45-4ef2-976e-91fddf5ac3e9","Type":"ContainerDied","Data":"8d31a501736e0f234b35cd52d52e77acccc197eb3097949b559a817dd9c09232"} Jun 03 00:31:56.967909 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.967727 2574 scope.go:117] "RemoveContainer" containerID="c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87" Jun 03 00:31:56.970986 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.970956 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdxwm\" (UniqueName: \"kubernetes.io/projected/26940ded-5d45-4ef2-976e-91fddf5ac3e9-kube-api-access-pdxwm\") on node \"ip-10-0-129-183.ec2.internal\" DevicePath \"\"" Jun 03 00:31:56.978317 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.978298 2574 scope.go:117] "RemoveContainer" containerID="c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87" Jun 03 00:31:56.978561 ip-10-0-129-183 kubenswrapper[2574]: E0603 00:31:56.978543 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87\": container with ID starting with c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87 not found: ID does not exist" containerID="c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87" Jun 03 00:31:56.978608 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.978569 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87"} err="failed to get container status \"c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87\": rpc error: code = NotFound desc = could not find container \"c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87\": container with ID starting with c900db27cbeac4cb1f1d8c88c3fa138d3e4d51fd54a8deb4aaeac43496ec8b87 not found: ID does not exist" Jun 03 00:31:56.991821 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.991798 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:31:56.995605 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:56.995586 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:31:57.014375 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.014351 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:31:57.014662 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.014649 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" Jun 03 00:31:57.014703 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.014663 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" Jun 03 00:31:57.014742 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.014723 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" containerName="keycloak" Jun 03 00:31:57.019026 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.019011 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:57.021362 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.021342 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 00:31:57.021529 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.021509 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 00:31:57.021680 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.021587 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 00:31:57.021680 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.021663 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-pk5xd\"" Jun 03 00:31:57.021826 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.021723 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 00:31:57.024275 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.024256 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:31:57.071810 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.071780 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd6gs\" (UniqueName: \"kubernetes.io/projected/e7aaa782-775d-4585-b9b1-325ec95e350e-kube-api-access-xd6gs\") pod \"maas-keycloak-0\" (UID: \"e7aaa782-775d-4585-b9b1-325ec95e350e\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:57.071927 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.071854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e7aaa782-775d-4585-b9b1-325ec95e350e-test-realms\") pod \"maas-keycloak-0\" (UID: \"e7aaa782-775d-4585-b9b1-325ec95e350e\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:57.172656 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.172629 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e7aaa782-775d-4585-b9b1-325ec95e350e-test-realms\") pod \"maas-keycloak-0\" (UID: \"e7aaa782-775d-4585-b9b1-325ec95e350e\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:57.172775 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.172687 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xd6gs\" (UniqueName: \"kubernetes.io/projected/e7aaa782-775d-4585-b9b1-325ec95e350e-kube-api-access-xd6gs\") pod \"maas-keycloak-0\" (UID: \"e7aaa782-775d-4585-b9b1-325ec95e350e\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:57.173299 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.173280 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/e7aaa782-775d-4585-b9b1-325ec95e350e-test-realms\") pod \"maas-keycloak-0\" (UID: \"e7aaa782-775d-4585-b9b1-325ec95e350e\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:57.182863 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.182833 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd6gs\" (UniqueName: \"kubernetes.io/projected/e7aaa782-775d-4585-b9b1-325ec95e350e-kube-api-access-xd6gs\") pod \"maas-keycloak-0\" (UID: \"e7aaa782-775d-4585-b9b1-325ec95e350e\") " pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:57.329378 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.329287 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:57.452727 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.452695 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 00:31:57.454946 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:31:57.454923 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7aaa782_775d_4585_b9b1_325ec95e350e.slice/crio-f1e2145f8fad78967f9c3ed966a3344ff75d0f054cdd5f6ffaf5857d97bade20 WatchSource:0}: Error finding container f1e2145f8fad78967f9c3ed966a3344ff75d0f054cdd5f6ffaf5857d97bade20: Status 404 returned error can't find the container with id f1e2145f8fad78967f9c3ed966a3344ff75d0f054cdd5f6ffaf5857d97bade20 Jun 03 00:31:57.456140 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.456119 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:31:57.972051 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.972016 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e7aaa782-775d-4585-b9b1-325ec95e350e","Type":"ContainerStarted","Data":"ea4da64db1d6279dd33c26bcb42ef28be3ec376ca19f0da0bb2b0497585efcb5"} Jun 03 00:31:57.972554 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.972058 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"e7aaa782-775d-4585-b9b1-325ec95e350e","Type":"ContainerStarted","Data":"f1e2145f8fad78967f9c3ed966a3344ff75d0f054cdd5f6ffaf5857d97bade20"} Jun 03 00:31:57.989520 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:57.989468 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.637489835 podStartE2EDuration="1.989452562s" podCreationTimestamp="2026-06-03 00:31:56 +0000 UTC" firstStartedPulling="2026-06-03 00:31:57.456257691 +0000 UTC m=+743.544065637" lastFinishedPulling="2026-06-03 00:31:57.808220412 +0000 UTC m=+743.896028364" observedRunningTime="2026-06-03 00:31:57.98747165 +0000 UTC m=+744.075279615" watchObservedRunningTime="2026-06-03 00:31:57.989452562 +0000 UTC m=+744.077260544" Jun 03 00:31:58.330034 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:58.329983 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 00:31:58.331529 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:58.331491 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:31:58.625088 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:58.625049 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26940ded-5d45-4ef2-976e-91fddf5ac3e9" path="/var/lib/kubelet/pods/26940ded-5d45-4ef2-976e-91fddf5ac3e9/volumes" Jun 03 00:31:59.329770 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:31:59.329720 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:00.330473 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:00.330435 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:01.330529 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:01.330472 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:02.330302 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:02.330249 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:03.330657 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:03.330606 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:04.330516 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:04.330452 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:05.330230 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:05.330157 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:06.330443 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:06.330398 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:07.330402 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:07.330349 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 00:32:07.330628 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:07.330588 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:08.330792 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:08.330732 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:09.330307 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:09.330254 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:10.330568 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:10.330518 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="Get \"http://10.132.0.30:9000/health/started\": dial tcp 10.132.0.30:9000: connect: connection refused" Jun 03 00:32:11.463319 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:11.463279 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 00:32:11.477568 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:11.477515 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="e7aaa782-775d-4585-b9b1-325ec95e350e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 00:32:21.469888 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:21.469849 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 00:32:42.314723 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.314691 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg"] Jun 03 00:32:42.319708 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.319688 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.323244 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.323220 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lzvzk\"" Jun 03 00:32:42.323360 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.323300 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 00:32:42.323360 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.323305 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 03 00:32:42.323476 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.323357 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 00:32:42.326418 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.326396 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg"] Jun 03 00:32:42.373551 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.373522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.373712 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.373563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2c6w\" (UniqueName: \"kubernetes.io/projected/afa986d1-a9da-4ec8-b40a-ad498bda6fff-kube-api-access-b2c6w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.373712 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.373599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.373712 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.373666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afa986d1-a9da-4ec8-b40a-ad498bda6fff-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.373712 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.373701 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.373840 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.373721 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474247 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474212 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474400 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474266 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afa986d1-a9da-4ec8-b40a-ad498bda6fff-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474400 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474380 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474490 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474417 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474490 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474475 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474649 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474518 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b2c6w\" (UniqueName: \"kubernetes.io/projected/afa986d1-a9da-4ec8-b40a-ad498bda6fff-kube-api-access-b2c6w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474649 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474610 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474748 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474729 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.474801 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.474761 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.476639 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.476619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/afa986d1-a9da-4ec8-b40a-ad498bda6fff-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.476902 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.476884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/afa986d1-a9da-4ec8-b40a-ad498bda6fff-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.481824 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.481800 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2c6w\" (UniqueName: \"kubernetes.io/projected/afa986d1-a9da-4ec8-b40a-ad498bda6fff-kube-api-access-b2c6w\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg\" (UID: \"afa986d1-a9da-4ec8-b40a-ad498bda6fff\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.631438 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.631409 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:42.760189 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:42.760163 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg"] Jun 03 00:32:42.762755 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:32:42.762724 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafa986d1_a9da_4ec8_b40a_ad498bda6fff.slice/crio-fa233f4b72b222c64a1da14829ec5f87d3d2e3c4f2c4bb24608ee5341267f9c4 WatchSource:0}: Error finding container fa233f4b72b222c64a1da14829ec5f87d3d2e3c4f2c4bb24608ee5341267f9c4: Status 404 returned error can't find the container with id fa233f4b72b222c64a1da14829ec5f87d3d2e3c4f2c4bb24608ee5341267f9c4 Jun 03 00:32:43.146641 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:43.146607 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" event={"ID":"afa986d1-a9da-4ec8-b40a-ad498bda6fff","Type":"ContainerStarted","Data":"fa233f4b72b222c64a1da14829ec5f87d3d2e3c4f2c4bb24608ee5341267f9c4"} Jun 03 00:32:47.162898 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:47.162854 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" event={"ID":"afa986d1-a9da-4ec8-b40a-ad498bda6fff","Type":"ContainerStarted","Data":"2ff84982dd2c634abe736d6ee75d19661d3c56fdcad7d72f5d5adff83b8a16d2"} Jun 03 00:32:48.169047 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:48.169008 2574 generic.go:358] "Generic (PLEG): container finished" podID="afa986d1-a9da-4ec8-b40a-ad498bda6fff" containerID="2ff84982dd2c634abe736d6ee75d19661d3c56fdcad7d72f5d5adff83b8a16d2" exitCode=0 Jun 03 00:32:48.169452 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:48.169070 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" event={"ID":"afa986d1-a9da-4ec8-b40a-ad498bda6fff","Type":"ContainerDied","Data":"2ff84982dd2c634abe736d6ee75d19661d3c56fdcad7d72f5d5adff83b8a16d2"} Jun 03 00:32:50.179895 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:50.179861 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" event={"ID":"afa986d1-a9da-4ec8-b40a-ad498bda6fff","Type":"ContainerStarted","Data":"5b8cb3d6c8a18aea7ddef04570129f44b4e4cf54c0d33ab06edb973570259979"} Jun 03 00:32:50.196838 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:50.196786 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" podStartSLOduration=1.711238088 podStartE2EDuration="8.196769801s" podCreationTimestamp="2026-06-03 00:32:42 +0000 UTC" firstStartedPulling="2026-06-03 00:32:42.764576838 +0000 UTC m=+788.852384797" lastFinishedPulling="2026-06-03 00:32:49.250108564 +0000 UTC m=+795.337916510" observedRunningTime="2026-06-03 00:32:50.194919617 +0000 UTC m=+796.282727584" watchObservedRunningTime="2026-06-03 00:32:50.196769801 +0000 UTC m=+796.284577767" Jun 03 00:32:51.313584 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.313547 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2"] Jun 03 00:32:51.317498 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.317475 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.319847 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.319813 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 00:32:51.325812 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.325591 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2"] Jun 03 00:32:51.355632 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.355594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.355632 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.355634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw82g\" (UniqueName: \"kubernetes.io/projected/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-kube-api-access-vw82g\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.355869 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.355670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.355869 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.355708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.355869 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.355746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.355869 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.355832 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457171 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457126 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457390 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457186 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457390 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457228 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vw82g\" (UniqueName: \"kubernetes.io/projected/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-kube-api-access-vw82g\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457390 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457251 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457390 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457270 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457390 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457298 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457762 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457733 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457841 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.457841 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.457804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.459668 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.459641 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.459801 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.459784 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.464864 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.464828 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw82g\" (UniqueName: \"kubernetes.io/projected/d3f1325c-8753-4748-a8e6-7bdb2bc381a8-kube-api-access-vw82g\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-drkw2\" (UID: \"d3f1325c-8753-4748-a8e6-7bdb2bc381a8\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.629810 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.629773 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:32:51.756384 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:51.756359 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2"] Jun 03 00:32:51.758229 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:32:51.758183 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3f1325c_8753_4748_a8e6_7bdb2bc381a8.slice/crio-2d213d0830b43950eccbee4d716825b3c58f24f27174701af8dfc8539ca05f04 WatchSource:0}: Error finding container 2d213d0830b43950eccbee4d716825b3c58f24f27174701af8dfc8539ca05f04: Status 404 returned error can't find the container with id 2d213d0830b43950eccbee4d716825b3c58f24f27174701af8dfc8539ca05f04 Jun 03 00:32:52.188822 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:52.188788 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" event={"ID":"d3f1325c-8753-4748-a8e6-7bdb2bc381a8","Type":"ContainerStarted","Data":"eea53905ba8116a2c1c8fc0e9bfdd1d2b0a4aa84831851988e9e08a4b00a024e"} Jun 03 00:32:52.188822 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:52.188826 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" event={"ID":"d3f1325c-8753-4748-a8e6-7bdb2bc381a8","Type":"ContainerStarted","Data":"2d213d0830b43950eccbee4d716825b3c58f24f27174701af8dfc8539ca05f04"} Jun 03 00:32:52.631756 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:52.631721 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:52.631756 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:52.631761 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:52.644025 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:52.644001 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:53.193783 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:53.193710 2574 generic.go:358] "Generic (PLEG): container finished" podID="d3f1325c-8753-4748-a8e6-7bdb2bc381a8" containerID="eea53905ba8116a2c1c8fc0e9bfdd1d2b0a4aa84831851988e9e08a4b00a024e" exitCode=0 Jun 03 00:32:53.193783 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:53.193766 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" event={"ID":"d3f1325c-8753-4748-a8e6-7bdb2bc381a8","Type":"ContainerDied","Data":"eea53905ba8116a2c1c8fc0e9bfdd1d2b0a4aa84831851988e9e08a4b00a024e"} Jun 03 00:32:53.205505 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:53.205482 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg" Jun 03 00:32:54.198777 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:54.198731 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" event={"ID":"d3f1325c-8753-4748-a8e6-7bdb2bc381a8","Type":"ContainerStarted","Data":"e2abd7b18fd05249b456ccce687696da4ee78fe784414ab54818e2d032803ca5"} Jun 03 00:32:54.217870 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:32:54.217813 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" podStartSLOduration=3.036890418 podStartE2EDuration="3.217795968s" podCreationTimestamp="2026-06-03 00:32:51 +0000 UTC" firstStartedPulling="2026-06-03 00:32:53.194442274 +0000 UTC m=+799.282250217" lastFinishedPulling="2026-06-03 00:32:53.375347825 +0000 UTC m=+799.463155767" observedRunningTime="2026-06-03 00:32:54.215324991 +0000 UTC m=+800.303132956" watchObservedRunningTime="2026-06-03 00:32:54.217795968 +0000 UTC m=+800.305603934" Jun 03 00:33:01.630580 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:01.630546 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:33:01.630580 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:01.630582 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:33:01.643387 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:01.643361 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:33:02.238648 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:02.238616 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-drkw2" Jun 03 00:33:13.727507 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.727473 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz"] Jun 03 00:33:13.745459 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.745427 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz"] Jun 03 00:33:13.745626 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.745568 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.748106 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.748069 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 00:33:13.848835 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.848792 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.848835 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.848840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.849093 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.848967 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.849093 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.849006 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.849093 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.849036 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/395ce530-de17-4192-a444-ecad29aa2a3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.849093 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.849082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7njkm\" (UniqueName: \"kubernetes.io/projected/395ce530-de17-4192-a444-ecad29aa2a3f-kube-api-access-7njkm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.950492 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950460 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.950492 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950494 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/395ce530-de17-4192-a444-ecad29aa2a3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.950741 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950519 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7njkm\" (UniqueName: \"kubernetes.io/projected/395ce530-de17-4192-a444-ecad29aa2a3f-kube-api-access-7njkm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.950741 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950562 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.950741 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950580 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.950741 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950652 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.950954 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.950954 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.951022 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.950976 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.953411 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.953383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/395ce530-de17-4192-a444-ecad29aa2a3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.953639 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.953624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/395ce530-de17-4192-a444-ecad29aa2a3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:13.958147 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:13.958125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7njkm\" (UniqueName: \"kubernetes.io/projected/395ce530-de17-4192-a444-ecad29aa2a3f-kube-api-access-7njkm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz\" (UID: \"395ce530-de17-4192-a444-ecad29aa2a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:14.056240 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:14.056108 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:14.187473 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:14.187444 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz"] Jun 03 00:33:14.189262 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:33:14.189231 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod395ce530_de17_4192_a444_ecad29aa2a3f.slice/crio-c267fe9e2df25b3f5f6a55d14434292cab36c44c380cb9bf2281360c7ed184ee WatchSource:0}: Error finding container c267fe9e2df25b3f5f6a55d14434292cab36c44c380cb9bf2281360c7ed184ee: Status 404 returned error can't find the container with id c267fe9e2df25b3f5f6a55d14434292cab36c44c380cb9bf2281360c7ed184ee Jun 03 00:33:14.267511 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:14.267466 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" event={"ID":"395ce530-de17-4192-a444-ecad29aa2a3f","Type":"ContainerStarted","Data":"3be90ec291f27230c676e8d3f05ae3cf51b2cbe6fd2387e3fcef70e55a6392f5"} Jun 03 00:33:14.267645 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:14.267529 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" event={"ID":"395ce530-de17-4192-a444-ecad29aa2a3f","Type":"ContainerStarted","Data":"c267fe9e2df25b3f5f6a55d14434292cab36c44c380cb9bf2281360c7ed184ee"} Jun 03 00:33:16.277663 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:16.277625 2574 generic.go:358] "Generic (PLEG): container finished" podID="395ce530-de17-4192-a444-ecad29aa2a3f" containerID="3be90ec291f27230c676e8d3f05ae3cf51b2cbe6fd2387e3fcef70e55a6392f5" exitCode=0 Jun 03 00:33:16.278058 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:16.277699 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" event={"ID":"395ce530-de17-4192-a444-ecad29aa2a3f","Type":"ContainerDied","Data":"3be90ec291f27230c676e8d3f05ae3cf51b2cbe6fd2387e3fcef70e55a6392f5"} Jun 03 00:33:17.282811 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:17.282776 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" event={"ID":"395ce530-de17-4192-a444-ecad29aa2a3f","Type":"ContainerStarted","Data":"743e357645093e98f87594a349e3f8fd1998b20da0e8d73262c3f2e74b00b26d"} Jun 03 00:33:17.301067 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:17.301017 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" podStartSLOduration=4.131681228 podStartE2EDuration="4.301002017s" podCreationTimestamp="2026-06-03 00:33:13 +0000 UTC" firstStartedPulling="2026-06-03 00:33:16.278329805 +0000 UTC m=+822.366137748" lastFinishedPulling="2026-06-03 00:33:16.447650591 +0000 UTC m=+822.535458537" observedRunningTime="2026-06-03 00:33:17.299471557 +0000 UTC m=+823.387279526" watchObservedRunningTime="2026-06-03 00:33:17.301002017 +0000 UTC m=+823.388809983" Jun 03 00:33:22.618866 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.618831 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn"] Jun 03 00:33:22.624481 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.624446 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.627575 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.627538 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 00:33:22.631351 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.631327 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn"] Jun 03 00:33:22.722832 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.722789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.723076 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.723050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.723147 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.723096 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqddx\" (UniqueName: \"kubernetes.io/projected/efed9f20-3784-40ec-ab7f-0919c219dfdc-kube-api-access-pqddx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.723261 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.723242 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.723427 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.723404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.723488 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.723469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efed9f20-3784-40ec-ab7f-0919c219dfdc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.824646 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.824598 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.824832 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.824654 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqddx\" (UniqueName: \"kubernetes.io/projected/efed9f20-3784-40ec-ab7f-0919c219dfdc-kube-api-access-pqddx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.824832 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.824732 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.824832 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.824792 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.824997 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.824828 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efed9f20-3784-40ec-ab7f-0919c219dfdc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.824997 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.824884 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.825136 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.825016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.825174 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.825131 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.825298 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.825269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.827069 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.827050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/efed9f20-3784-40ec-ab7f-0919c219dfdc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.827376 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.827356 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/efed9f20-3784-40ec-ab7f-0919c219dfdc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.833277 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.833251 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqddx\" (UniqueName: \"kubernetes.io/projected/efed9f20-3784-40ec-ab7f-0919c219dfdc-kube-api-access-pqddx\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn\" (UID: \"efed9f20-3784-40ec-ab7f-0919c219dfdc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:22.936665 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:22.936581 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:23.065824 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:23.065798 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn"] Jun 03 00:33:23.067908 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:33:23.067875 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefed9f20_3784_40ec_ab7f_0919c219dfdc.slice/crio-b6edfcd171170abb887cc4ae280c84da54f0b62906c690e3b719029f85fbf20c WatchSource:0}: Error finding container b6edfcd171170abb887cc4ae280c84da54f0b62906c690e3b719029f85fbf20c: Status 404 returned error can't find the container with id b6edfcd171170abb887cc4ae280c84da54f0b62906c690e3b719029f85fbf20c Jun 03 00:33:23.305299 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:23.305181 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" event={"ID":"efed9f20-3784-40ec-ab7f-0919c219dfdc","Type":"ContainerStarted","Data":"0cab5ddc8aa3e78cab4e527bcd53ee6e64e01ac3db22a5001295b40cbcf709c6"} Jun 03 00:33:23.305299 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:23.305249 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" event={"ID":"efed9f20-3784-40ec-ab7f-0919c219dfdc","Type":"ContainerStarted","Data":"b6edfcd171170abb887cc4ae280c84da54f0b62906c690e3b719029f85fbf20c"} Jun 03 00:33:24.056534 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:24.056498 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:24.056534 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:24.056539 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:24.073779 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:24.073730 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:24.323736 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:24.323651 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz" Jun 03 00:33:25.315962 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:25.315927 2574 generic.go:358] "Generic (PLEG): container finished" podID="efed9f20-3784-40ec-ab7f-0919c219dfdc" containerID="0cab5ddc8aa3e78cab4e527bcd53ee6e64e01ac3db22a5001295b40cbcf709c6" exitCode=0 Jun 03 00:33:25.316386 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:25.316001 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" event={"ID":"efed9f20-3784-40ec-ab7f-0919c219dfdc","Type":"ContainerDied","Data":"0cab5ddc8aa3e78cab4e527bcd53ee6e64e01ac3db22a5001295b40cbcf709c6"} Jun 03 00:33:26.321443 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:26.321413 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" event={"ID":"efed9f20-3784-40ec-ab7f-0919c219dfdc","Type":"ContainerStarted","Data":"86e15b2ca63569ff91d1edbe3128b1b84b7a5dc894c8c2cb4f23f6c2fb4e3146"} Jun 03 00:33:26.339704 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:26.339657 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" podStartSLOduration=4.175137588 podStartE2EDuration="4.339644589s" podCreationTimestamp="2026-06-03 00:33:22 +0000 UTC" firstStartedPulling="2026-06-03 00:33:25.316745159 +0000 UTC m=+831.404553103" lastFinishedPulling="2026-06-03 00:33:25.481252158 +0000 UTC m=+831.569060104" observedRunningTime="2026-06-03 00:33:26.336818374 +0000 UTC m=+832.424626340" watchObservedRunningTime="2026-06-03 00:33:26.339644589 +0000 UTC m=+832.427452552" Jun 03 00:33:29.514372 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.514331 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc"] Jun 03 00:33:29.518804 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.518783 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.521536 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.521513 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 00:33:29.527029 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.526933 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc"] Jun 03 00:33:29.687891 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.687853 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcrxr\" (UniqueName: \"kubernetes.io/projected/13133167-6748-492a-a88d-4c9aba2e09a2-kube-api-access-gcrxr\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.688047 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.687902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.688047 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.687929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.688047 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.688004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13133167-6748-492a-a88d-4c9aba2e09a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.688190 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.688090 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.688190 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.688113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789153 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789055 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcrxr\" (UniqueName: \"kubernetes.io/projected/13133167-6748-492a-a88d-4c9aba2e09a2-kube-api-access-gcrxr\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789153 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789111 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789153 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789139 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789452 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789171 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13133167-6748-492a-a88d-4c9aba2e09a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789452 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789277 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789452 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789303 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789601 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.789775 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.789712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.791546 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.791522 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13133167-6748-492a-a88d-4c9aba2e09a2-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.791787 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.791768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13133167-6748-492a-a88d-4c9aba2e09a2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.796173 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.796154 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcrxr\" (UniqueName: \"kubernetes.io/projected/13133167-6748-492a-a88d-4c9aba2e09a2-kube-api-access-gcrxr\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc\" (UID: \"13133167-6748-492a-a88d-4c9aba2e09a2\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.831964 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.831936 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:29.960061 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:29.960034 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc"] Jun 03 00:33:29.961842 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:33:29.961806 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13133167_6748_492a_a88d_4c9aba2e09a2.slice/crio-0242025a498c02f290fce5f707c5288d42582cb63fed70527f7a88ab546379f1 WatchSource:0}: Error finding container 0242025a498c02f290fce5f707c5288d42582cb63fed70527f7a88ab546379f1: Status 404 returned error can't find the container with id 0242025a498c02f290fce5f707c5288d42582cb63fed70527f7a88ab546379f1 Jun 03 00:33:30.334803 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:30.334768 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" event={"ID":"13133167-6748-492a-a88d-4c9aba2e09a2","Type":"ContainerStarted","Data":"6a6998142b489614f02bff94a2a525b2409045d4703b290e60ba113dacc66332"} Jun 03 00:33:30.334803 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:30.334806 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" event={"ID":"13133167-6748-492a-a88d-4c9aba2e09a2","Type":"ContainerStarted","Data":"0242025a498c02f290fce5f707c5288d42582cb63fed70527f7a88ab546379f1"} Jun 03 00:33:31.339118 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:31.339088 2574 generic.go:358] "Generic (PLEG): container finished" podID="13133167-6748-492a-a88d-4c9aba2e09a2" containerID="6a6998142b489614f02bff94a2a525b2409045d4703b290e60ba113dacc66332" exitCode=0 Jun 03 00:33:31.339556 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:31.339152 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" event={"ID":"13133167-6748-492a-a88d-4c9aba2e09a2","Type":"ContainerDied","Data":"6a6998142b489614f02bff94a2a525b2409045d4703b290e60ba113dacc66332"} Jun 03 00:33:32.345620 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:32.345584 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" event={"ID":"13133167-6748-492a-a88d-4c9aba2e09a2","Type":"ContainerStarted","Data":"08bcef76c9b9688811d27df057ba1e2de2f4bc41788b9b3c42c0ec902eecace0"} Jun 03 00:33:32.362978 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:32.362931 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" podStartSLOduration=3.175540924 podStartE2EDuration="3.362917411s" podCreationTimestamp="2026-06-03 00:33:29 +0000 UTC" firstStartedPulling="2026-06-03 00:33:31.339789798 +0000 UTC m=+837.427597743" lastFinishedPulling="2026-06-03 00:33:31.527166286 +0000 UTC m=+837.614974230" observedRunningTime="2026-06-03 00:33:32.361241858 +0000 UTC m=+838.449049826" watchObservedRunningTime="2026-06-03 00:33:32.362917411 +0000 UTC m=+838.450725376" Jun 03 00:33:32.937282 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:32.937249 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:32.937461 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:32.937329 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:32.949640 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:32.949614 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:33.360721 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:33.360693 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn" Jun 03 00:33:39.832055 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:39.832017 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:39.832055 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:39.832071 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:39.844589 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:39.844569 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:40.385571 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:40.385541 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc" Jun 03 00:33:41.824621 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.824587 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7"] Jun 03 00:33:41.830682 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.830662 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.834049 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.834020 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 00:33:41.835434 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.835413 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7"] Jun 03 00:33:41.890038 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.890004 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.890038 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.890038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.890275 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.890065 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.890275 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.890167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k6w2\" (UniqueName: \"kubernetes.io/projected/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-kube-api-access-8k6w2\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.890275 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.890240 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.890275 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.890268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991068 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991037 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991288 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991089 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991288 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991110 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991288 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991140 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991288 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991178 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8k6w2\" (UniqueName: \"kubernetes.io/projected/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-kube-api-access-8k6w2\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991288 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991243 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991553 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991605 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991553 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.991642 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.991623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.993469 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.993443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.993658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.993643 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:41.999243 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:41.999216 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k6w2\" (UniqueName: \"kubernetes.io/projected/c08dcf2b-36ca-4fa6-b746-b9c3881436a4-kube-api-access-8k6w2\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7\" (UID: \"c08dcf2b-36ca-4fa6-b746-b9c3881436a4\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:42.142819 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:42.142788 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" Jun 03 00:33:42.274158 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:42.274131 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7"] Jun 03 00:33:42.276144 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:33:42.276115 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08dcf2b_36ca_4fa6_b746_b9c3881436a4.slice/crio-9f3b8b3c49d9def176333c0c31f1a688402dba0170bbb54a6b35fc9b92059aee WatchSource:0}: Error finding container 9f3b8b3c49d9def176333c0c31f1a688402dba0170bbb54a6b35fc9b92059aee: Status 404 returned error can't find the container with id 9f3b8b3c49d9def176333c0c31f1a688402dba0170bbb54a6b35fc9b92059aee Jun 03 00:33:42.382725 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:42.382689 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" event={"ID":"c08dcf2b-36ca-4fa6-b746-b9c3881436a4","Type":"ContainerStarted","Data":"68042e76ca3aef94a7ba2abf8b1f7598400295253f4def2032b6868723bad337"} Jun 03 00:33:42.382725 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:33:42.382725 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7" event={"ID":"c08dcf2b-36ca-4fa6-b746-b9c3881436a4","Type":"ContainerStarted","Data":"9f3b8b3c49d9def176333c0c31f1a688402dba0170bbb54a6b35fc9b92059aee"} Jun 03 00:34:34.546506 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:34:34.546427 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:34:34.549752 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:34:34.547593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:39:12.120683 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:12.120601 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7_c08dcf2b-36ca-4fa6-b746-b9c3881436a4/storage-initializer/0.log" Jun 03 00:39:17.545257 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:17.545224 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-767d585f79-jgqdw_a090a75f-4016-4347-af7e-1a451f9e9373/nginx/0.log" Jun 03 00:39:17.648444 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:17.648414 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-mvrgk_fd457116-fb1f-44b5-ad97-2f23e2eb6807/manager/0.log" Jun 03 00:39:17.765818 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:17.765784 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-4tsgb_8f4b1b07-daec-4fbb-b907-9bd04bdd421b/manager/0.log" Jun 03 00:39:18.433053 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:18.433022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz_22e775fe-4fa5-4c35-9290-87ec14bd689b/copy-manifests/0.log" Jun 03 00:39:18.445558 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:18.445533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz_22e775fe-4fa5-4c35-9290-87ec14bd689b/manager/0.log" Jun 03 00:39:18.672084 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:18.672057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-gsnj6_9a8a5119-4a3f-4e8e-87f6-e963362d1266/postgres/0.log" Jun 03 00:39:20.071570 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:20.071541 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-5hvlc_0e10de48-4396-451e-9edb-2046a3e8d122/manager/0.log" Jun 03 00:39:21.220483 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:21.220445 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-wb2gx_234d422b-5977-4b4c-a0a0-5f95790ccaf4/discovery/0.log" Jun 03 00:39:21.334879 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:21.334849 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7584859df7-d4hx8_f4a54541-500f-43ca-a016-b0bfcc2123ac/kube-auth-proxy/0.log" Jun 03 00:39:22.121842 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.121813 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg_afa986d1-a9da-4ec8-b40a-ad498bda6fff/storage-initializer/0.log" Jun 03 00:39:22.128732 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.128705 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-jf6fg_afa986d1-a9da-4ec8-b40a-ad498bda6fff/main/0.log" Jun 03 00:39:22.238030 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.238000 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-drkw2_d3f1325c-8753-4748-a8e6-7bdb2bc381a8/storage-initializer/0.log" Jun 03 00:39:22.244984 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.244960 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-drkw2_d3f1325c-8753-4748-a8e6-7bdb2bc381a8/main/0.log" Jun 03 00:39:22.350239 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.350212 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz_395ce530-de17-4192-a444-ecad29aa2a3f/storage-initializer/0.log" Jun 03 00:39:22.356968 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.356951 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-g2grz_395ce530-de17-4192-a444-ecad29aa2a3f/main/0.log" Jun 03 00:39:22.465984 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.465915 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn_efed9f20-3784-40ec-ab7f-0919c219dfdc/storage-initializer/0.log" Jun 03 00:39:22.472920 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.472898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f986xfn_efed9f20-3784-40ec-ab7f-0919c219dfdc/main/0.log" Jun 03 00:39:22.578488 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.578463 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc_13133167-6748-492a-a88d-4c9aba2e09a2/storage-initializer/0.log" Jun 03 00:39:22.585343 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.585325 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-tz4cc_13133167-6748-492a-a88d-4c9aba2e09a2/main/0.log" Jun 03 00:39:22.693087 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:22.693065 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-xq2d7_c08dcf2b-36ca-4fa6-b746-b9c3881436a4/storage-initializer/0.log" Jun 03 00:39:29.414790 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:29.414760 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-45fpl_01b66153-7b87-414b-8b51-1d96488e7f8a/global-pull-secret-syncer/0.log" Jun 03 00:39:29.540118 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:29.540088 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bfhvp_1dde7c0f-7852-44c4-a696-0a3b284f4081/konnectivity-agent/0.log" Jun 03 00:39:29.613512 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:29.613488 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-183.ec2.internal_626dfd556dd473bd24bb26139b71b711/haproxy/0.log" Jun 03 00:39:33.325500 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:33.325472 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-5hvlc_0e10de48-4396-451e-9edb-2046a3e8d122/manager/0.log" Jun 03 00:39:34.575639 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:34.575596 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:39:34.579166 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:34.579140 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:39:35.041056 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.041028 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-cbb5s_0b1238f1-e829-499b-aa6d-bf5dbfcace10/cluster-monitoring-operator/0.log" Jun 03 00:39:35.206999 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.206972 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ldwb6_5bd7967e-5cda-44a5-b758-f6f3459f62df/node-exporter/0.log" Jun 03 00:39:35.227475 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.227452 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ldwb6_5bd7967e-5cda-44a5-b758-f6f3459f62df/kube-rbac-proxy/0.log" Jun 03 00:39:35.248213 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.248179 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ldwb6_5bd7967e-5cda-44a5-b758-f6f3459f62df/init-textfile/0.log" Jun 03 00:39:35.904858 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.904825 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-599b585758-nqdvs_94de7b2a-d874-4671-89f9-95a1d55e1eed/thanos-query/0.log" Jun 03 00:39:35.927426 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.927402 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-599b585758-nqdvs_94de7b2a-d874-4671-89f9-95a1d55e1eed/kube-rbac-proxy-web/0.log" Jun 03 00:39:35.950211 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.950175 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-599b585758-nqdvs_94de7b2a-d874-4671-89f9-95a1d55e1eed/kube-rbac-proxy/0.log" Jun 03 00:39:35.971724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.971669 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-599b585758-nqdvs_94de7b2a-d874-4671-89f9-95a1d55e1eed/prom-label-proxy/0.log" Jun 03 00:39:35.992484 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:35.992466 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-599b585758-nqdvs_94de7b2a-d874-4671-89f9-95a1d55e1eed/kube-rbac-proxy-rules/0.log" Jun 03 00:39:36.020297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:36.020279 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-599b585758-nqdvs_94de7b2a-d874-4671-89f9-95a1d55e1eed/kube-rbac-proxy-metrics/0.log" Jun 03 00:39:39.193864 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.193831 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8"] Jun 03 00:39:39.197467 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.197448 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.199658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.199636 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6sc4\"/\"openshift-service-ca.crt\"" Jun 03 00:39:39.199770 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.199682 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6sc4\"/\"default-dockercfg-p48kg\"" Jun 03 00:39:39.200778 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.200757 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6sc4\"/\"kube-root-ca.crt\"" Jun 03 00:39:39.205671 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.205650 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8"] Jun 03 00:39:39.300809 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.300776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-podres\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.300975 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.300824 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-lib-modules\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.300975 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.300951 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-sys\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.301078 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.300999 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsdns\" (UniqueName: \"kubernetes.io/projected/d9d52352-1213-483f-bee1-6787d7388ebd-kube-api-access-jsdns\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.301078 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.301067 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-proc\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402373 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402349 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jsdns\" (UniqueName: \"kubernetes.io/projected/d9d52352-1213-483f-bee1-6787d7388ebd-kube-api-access-jsdns\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402510 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402389 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-proc\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402510 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402409 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-podres\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402510 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402457 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-lib-modules\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402523 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-sys\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-proc\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402598 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-sys\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402650 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-podres\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.402822 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.402666 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d9d52352-1213-483f-bee1-6787d7388ebd-lib-modules\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.409967 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.409940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsdns\" (UniqueName: \"kubernetes.io/projected/d9d52352-1213-483f-bee1-6787d7388ebd-kube-api-access-jsdns\") pod \"perf-node-gather-daemonset-c6kq8\" (UID: \"d9d52352-1213-483f-bee1-6787d7388ebd\") " pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.508334 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.508268 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:39.636648 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.636623 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8"] Jun 03 00:39:39.638801 ip-10-0-129-183 kubenswrapper[2574]: W0603 00:39:39.638769 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd9d52352_1213_483f_bee1_6787d7388ebd.slice/crio-a9049b22342469f4185fb4a4bf5a16669dac72b2b48508ef6075ffcbeeae5e6b WatchSource:0}: Error finding container a9049b22342469f4185fb4a4bf5a16669dac72b2b48508ef6075ffcbeeae5e6b: Status 404 returned error can't find the container with id a9049b22342469f4185fb4a4bf5a16669dac72b2b48508ef6075ffcbeeae5e6b Jun 03 00:39:39.640297 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.640279 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 00:39:39.667442 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.667414 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" event={"ID":"d9d52352-1213-483f-bee1-6787d7388ebd","Type":"ContainerStarted","Data":"a9049b22342469f4185fb4a4bf5a16669dac72b2b48508ef6075ffcbeeae5e6b"} Jun 03 00:39:39.916453 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.916423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xdhhv_eefd36b7-077a-4ffb-a886-28acaba8d024/dns/0.log" Jun 03 00:39:39.939114 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.939089 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xdhhv_eefd36b7-077a-4ffb-a886-28acaba8d024/kube-rbac-proxy/0.log" Jun 03 00:39:39.989010 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:39.988987 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f8hvl_3c455288-52d8-48a5-8839-0bc3c874c168/dns-node-resolver/0.log" Jun 03 00:39:40.484526 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:40.484493 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ndzr2_754c1b71-4865-43d6-ab7d-982df313977c/node-ca/0.log" Jun 03 00:39:40.672724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:40.672687 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" event={"ID":"d9d52352-1213-483f-bee1-6787d7388ebd","Type":"ContainerStarted","Data":"386db2c3e79a91d3e09009fe1e5c1a9dbc2dc7a1b8874fcb70edfd8bec211347"} Jun 03 00:39:40.672894 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:40.672823 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:40.688159 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:40.688111 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" podStartSLOduration=1.688101383 podStartE2EDuration="1.688101383s" podCreationTimestamp="2026-06-03 00:39:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 00:39:40.686368619 +0000 UTC m=+1206.774176585" watchObservedRunningTime="2026-06-03 00:39:40.688101383 +0000 UTC m=+1206.775909354" Jun 03 00:39:41.368098 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:41.368065 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-wb2gx_234d422b-5977-4b4c-a0a0-5f95790ccaf4/discovery/0.log" Jun 03 00:39:41.386973 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:41.386946 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7584859df7-d4hx8_f4a54541-500f-43ca-a016-b0bfcc2123ac/kube-auth-proxy/0.log" Jun 03 00:39:42.037803 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:42.037780 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rk7hj_ffb74965-df28-4cbf-8cdf-21ef1f693101/serve-healthcheck-canary/0.log" Jun 03 00:39:42.591066 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:42.591040 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hcjxk_5dcc9a34-1045-4d71-b332-240771005d85/kube-rbac-proxy/0.log" Jun 03 00:39:42.614309 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:42.614283 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hcjxk_5dcc9a34-1045-4d71-b332-240771005d85/exporter/0.log" Jun 03 00:39:42.635138 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:42.635114 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hcjxk_5dcc9a34-1045-4d71-b332-240771005d85/extractor/0.log" Jun 03 00:39:44.549539 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:44.549510 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-767d585f79-jgqdw_a090a75f-4016-4347-af7e-1a451f9e9373/nginx/0.log" Jun 03 00:39:44.572780 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:44.572756 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-mvrgk_fd457116-fb1f-44b5-ad97-2f23e2eb6807/manager/0.log" Jun 03 00:39:44.604335 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:44.604307 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-4tsgb_8f4b1b07-daec-4fbb-b907-9bd04bdd421b/manager/0.log" Jun 03 00:39:44.822919 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:44.822839 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz_22e775fe-4fa5-4c35-9290-87ec14bd689b/manager/0.log" Jun 03 00:39:44.839522 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:44.839497 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76cf9fb4b6-9dnlz_22e775fe-4fa5-4c35-9290-87ec14bd689b/copy-manifests/0.log" Jun 03 00:39:44.918461 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:44.918436 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-gsnj6_9a8a5119-4a3f-4e8e-87f6-e963362d1266/postgres/0.log" Jun 03 00:39:46.185658 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:46.185628 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-rb8dd_64906a9e-bab0-4e4e-9bc2-1fc4c28ab0c6/openshift-lws-operator/0.log" Jun 03 00:39:46.686647 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:46.686622 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n6sc4/perf-node-gather-daemonset-c6kq8" Jun 03 00:39:52.129048 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.129020 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2tc8k_b7b24aa7-3804-471c-a6ed-f4d332b281b6/kube-multus/0.log" Jun 03 00:39:52.485960 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.485891 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqmj8_5819615f-aa8e-4984-bb02-29088c6d02a1/kube-multus-additional-cni-plugins/0.log" Jun 03 00:39:52.506257 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.506234 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqmj8_5819615f-aa8e-4984-bb02-29088c6d02a1/egress-router-binary-copy/0.log" Jun 03 00:39:52.526141 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.526119 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqmj8_5819615f-aa8e-4984-bb02-29088c6d02a1/cni-plugins/0.log" Jun 03 00:39:52.547097 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.547078 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqmj8_5819615f-aa8e-4984-bb02-29088c6d02a1/bond-cni-plugin/0.log" Jun 03 00:39:52.568672 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.568655 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqmj8_5819615f-aa8e-4984-bb02-29088c6d02a1/routeoverride-cni/0.log" Jun 03 00:39:52.589171 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.589151 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqmj8_5819615f-aa8e-4984-bb02-29088c6d02a1/whereabouts-cni-bincopy/0.log" Jun 03 00:39:52.609431 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.609413 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqmj8_5819615f-aa8e-4984-bb02-29088c6d02a1/whereabouts-cni/0.log" Jun 03 00:39:52.691968 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.691935 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8hgnw_3b116e3e-08e8-4935-8ae4-8a9b932a43b3/network-metrics-daemon/0.log" Jun 03 00:39:52.711078 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:52.711057 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8hgnw_3b116e3e-08e8-4935-8ae4-8a9b932a43b3/kube-rbac-proxy/0.log" Jun 03 00:39:53.657034 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.657003 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-controller/0.log" Jun 03 00:39:53.675578 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.675556 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/0.log" Jun 03 00:39:53.680724 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.680706 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovn-acl-logging/1.log" Jun 03 00:39:53.698683 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.698664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/kube-rbac-proxy-node/0.log" Jun 03 00:39:53.718844 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.718815 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/kube-rbac-proxy-ovn-metrics/0.log" Jun 03 00:39:53.738533 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.738512 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/northd/0.log" Jun 03 00:39:53.758732 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.758711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/nbdb/0.log" Jun 03 00:39:53.783354 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.783326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/sbdb/0.log" Jun 03 00:39:53.899421 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:53.899393 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-f8zgw_212d59ce-03c1-4171-bd89-367abf0c31f5/ovnkube-controller/0.log" Jun 03 00:39:55.559490 ip-10-0-129-183 kubenswrapper[2574]: I0603 00:39:55.559458 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tmngv_03fb21a5-15bb-4eee-80d1-c368a2a50300/network-check-target-container/0.log"