Jun 03 15:00:53.274608 ip-10-0-133-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 03 15:00:53.274619 ip-10-0-133-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 03 15:00:53.274629 ip-10-0-133-0 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 03 15:00:53.274939 ip-10-0-133-0 systemd[1]: Failed to start Kubernetes Kubelet. Jun 03 15:01:03.280133 ip-10-0-133-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 03 15:01:03.280149 ip-10-0-133-0 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 671850497bae4fd9891dd6735cdbbe08 -- Jun 03 15:03:35.553756 ip-10-0-133-0 systemd[1]: Starting Kubernetes Kubelet... Jun 03 15:03:35.992169 ip-10-0-133-0 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:03:35.992169 ip-10-0-133-0 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 15:03:35.992169 ip-10-0-133-0 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:03:35.992169 ip-10-0-133-0 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 15:03:35.992169 ip-10-0-133-0 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 15:03:35.993205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.993115 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 15:03:35.996826 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996811 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996827 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996833 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996836 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996839 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996842 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996844 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996848 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996851 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996854 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996856 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996859 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996861 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996864 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996866 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996869 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996871 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996874 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:35.996868 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996877 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996880 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996883 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996885 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996888 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996890 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996893 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996895 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996897 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996900 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996902 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996905 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996908 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996910 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996913 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996915 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996918 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996920 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996922 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:35.997301 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996925 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996927 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996930 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996932 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996935 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996937 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996939 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996942 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996944 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996947 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996949 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996951 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996954 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996956 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996958 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996961 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996964 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996967 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996969 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996972 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:35.998029 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996974 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996976 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996979 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996983 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996985 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996987 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996990 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996992 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996995 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.996997 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997000 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997003 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997005 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997008 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997010 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997013 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997017 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997019 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997022 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997024 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:35.998554 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997027 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:35.999073 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997029 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:35.999073 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997033 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:35.999073 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997037 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:35.999073 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997041 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:35.999073 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997043 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:35.999073 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997046 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:35.999073 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997050 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:35.999073 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.997053 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:35.999560 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999544 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999560 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999566 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999569 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999573 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999575 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999578 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999581 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999583 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999586 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999588 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999591 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999594 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999596 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999599 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999601 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:35.999597 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999604 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999607 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999610 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999613 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999615 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999617 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999620 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999622 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999625 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999627 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999629 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999632 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999634 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999637 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999644 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999647 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999649 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999652 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999655 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999657 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:35.999976 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999659 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999661 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999664 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999666 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999668 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999670 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999673 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999675 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999678 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999681 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999684 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999686 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999688 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999691 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999696 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999700 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999703 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999706 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999709 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999711 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:36.000518 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999714 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999717 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999720 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999722 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999725 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999727 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999729 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999732 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999734 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999737 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999739 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999742 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999744 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999747 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999749 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999751 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999754 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999756 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999759 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999761 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:36.001004 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999765 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999770 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999773 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999775 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999778 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999781 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999783 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999786 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999788 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:35.999791 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999874 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999885 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999894 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999899 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999904 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999907 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999911 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999915 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999918 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999921 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999926 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 15:03:36.001509 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999929 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999932 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999935 2574 flags.go:64] FLAG: --cgroup-root="" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999937 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999940 2574 flags.go:64] FLAG: --client-ca-file="" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999943 2574 flags.go:64] FLAG: --cloud-config="" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999946 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999948 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999953 2574 flags.go:64] FLAG: --cluster-domain="" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999956 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999959 2574 flags.go:64] FLAG: --config-dir="" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999962 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999965 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999975 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999978 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999981 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999985 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999988 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999991 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999994 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:35.999997 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000000 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000004 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000007 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000010 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 15:03:36.002100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000013 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000016 2574 flags.go:64] FLAG: --enable-server="true" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000018 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000023 2574 flags.go:64] FLAG: --event-burst="100" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000026 2574 flags.go:64] FLAG: --event-qps="50" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000029 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000032 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000035 2574 flags.go:64] FLAG: --eviction-hard="" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000039 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000042 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000044 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000047 2574 flags.go:64] FLAG: --eviction-soft="" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000050 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000053 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000055 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000059 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000062 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000065 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000068 2574 flags.go:64] FLAG: --feature-gates="" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000072 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000074 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000078 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000081 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000085 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000088 2574 flags.go:64] FLAG: --help="false" Jun 03 15:03:36.002734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000091 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000094 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000097 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000100 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000103 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000106 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000109 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000112 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000114 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000117 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000120 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000123 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000125 2574 flags.go:64] FLAG: --kube-reserved="" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000128 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000131 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000134 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000137 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000140 2574 flags.go:64] FLAG: --lock-file="" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000142 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000146 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000148 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000158 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000161 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000164 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 15:03:36.003327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000168 2574 flags.go:64] FLAG: --logging-format="text" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000170 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000173 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000176 2574 flags.go:64] FLAG: --manifest-url="" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000179 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000184 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000187 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000191 2574 flags.go:64] FLAG: --max-pods="110" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000194 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000197 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000200 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000202 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000205 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000208 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000211 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000218 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000221 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000224 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000227 2574 flags.go:64] FLAG: --pod-cidr="" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000229 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000235 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000237 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000240 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000243 2574 flags.go:64] FLAG: --port="10250" Jun 03 15:03:36.003926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000246 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000249 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ed6db491c93904bc" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000252 2574 flags.go:64] FLAG: --qos-reserved="" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000254 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000257 2574 flags.go:64] FLAG: --register-node="true" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000260 2574 flags.go:64] FLAG: --register-schedulable="true" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000263 2574 flags.go:64] FLAG: --register-with-taints="" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000267 2574 flags.go:64] FLAG: --registry-burst="10" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000270 2574 flags.go:64] FLAG: --registry-qps="5" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000272 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000275 2574 flags.go:64] FLAG: --reserved-memory="" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000279 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000282 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000285 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000288 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000292 2574 flags.go:64] FLAG: --runonce="false" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000295 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000298 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000301 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000303 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000306 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000309 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000312 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000315 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000317 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000320 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 15:03:36.004514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000322 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000325 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000328 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000330 2574 flags.go:64] FLAG: --system-cgroups="" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000333 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000338 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000341 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000344 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000348 2574 flags.go:64] FLAG: --tls-min-version="" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000350 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000353 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000356 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000359 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000362 2574 flags.go:64] FLAG: --v="2" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000366 2574 flags.go:64] FLAG: --version="false" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000370 2574 flags.go:64] FLAG: --vmodule="" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000374 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.000377 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000487 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000491 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000494 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000498 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000501 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000504 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:36.005173 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000506 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000509 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000511 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000514 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000517 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000519 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000522 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000524 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000527 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000529 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000532 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000534 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000537 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000539 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000542 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000544 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000547 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000550 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000552 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000555 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:36.005763 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000557 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000559 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000562 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000564 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000567 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000569 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000572 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000575 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000577 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000580 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000582 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000585 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000587 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000590 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000592 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000595 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000597 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000599 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000603 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:36.006269 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000606 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000609 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000612 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000614 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000616 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000619 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000621 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000624 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000626 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000628 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000631 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000633 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000636 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000645 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000647 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000650 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000652 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000654 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000657 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000662 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:36.007161 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000664 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000667 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000669 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000672 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000674 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000677 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000679 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000682 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000684 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000687 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000689 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000692 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000694 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000697 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000700 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000704 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000706 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000709 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000711 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:36.008023 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000713 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.000716 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.001353 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.008355 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.008378 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008470 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008478 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008483 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008489 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008493 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008498 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008502 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008506 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008511 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008515 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008519 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:36.008866 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008524 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008528 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008533 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008537 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008541 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008545 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008549 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008553 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008558 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008562 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008566 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008570 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008574 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008579 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008583 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008587 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008592 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008596 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008600 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008604 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:36.009588 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008609 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008613 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008618 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008622 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008626 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008630 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008634 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008641 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008648 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008653 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008657 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008662 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008666 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008671 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008675 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008679 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008683 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008687 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008691 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:36.010165 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008695 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008700 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008705 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008709 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008714 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008718 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008722 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008726 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008730 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008734 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008738 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008742 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008746 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008750 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008780 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008788 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008793 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008798 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008802 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008807 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:36.011054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008811 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008815 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008819 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008823 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008827 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008831 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008835 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008839 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008845 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008850 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008855 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008860 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008864 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008869 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008874 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:36.011915 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.008878 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.008886 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009071 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009079 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009084 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009089 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009093 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009098 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009103 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009107 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009112 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009117 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009122 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009126 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009131 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009134 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 15:03:36.012306 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009139 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009142 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009146 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009150 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009154 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009159 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009163 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009167 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009171 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009175 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009178 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009183 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009186 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009190 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009195 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009199 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009204 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009208 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009212 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009215 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 15:03:36.012844 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009219 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009223 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009227 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009231 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009235 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009238 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009243 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009248 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009252 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009256 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009261 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009265 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009269 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009273 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009277 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009281 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009285 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009289 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009293 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009297 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 15:03:36.013330 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009301 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009305 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009309 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009313 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009317 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009321 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009326 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009330 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009334 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009338 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009342 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009346 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009350 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009354 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009358 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009362 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009365 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009369 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009373 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009377 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 15:03:36.013887 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009381 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009385 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009390 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009394 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009398 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009402 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009409 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009414 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009419 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009424 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009428 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:36.009434 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.009459 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.009616 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 15:03:36.014418 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.012354 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 15:03:36.014781 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.013357 2574 server.go:1019] "Starting client certificate rotation" Jun 03 15:03:36.014781 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.013471 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:03:36.014781 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.013506 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 15:03:36.037541 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.037519 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:03:36.040437 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.040419 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 15:03:36.056685 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.056664 2574 log.go:25] "Validated CRI v1 runtime API" Jun 03 15:03:36.062515 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.062499 2574 log.go:25] "Validated CRI v1 image API" Jun 03 15:03:36.063681 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.063667 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 15:03:36.067556 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.067533 2574 fs.go:135] Filesystem UUIDs: map[5037d689-616e-4c2d-bd26-e09248d2bc31:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dc266789-63ae-4b0b-8862-dbf1bed6633b:/dev/nvme0n1p4] Jun 03 15:03:36.067626 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.067556 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 15:03:36.071844 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.071744 2574 manager.go:217] Machine: {Timestamp:2026-06-03 15:03:36.071231288 +0000 UTC m=+0.394388582 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099923 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29e6974cd66367d73d5afae1b434df SystemUUID:ec29e697-4cd6-6367-d73d-5afae1b434df BootID:67185049-7bae-4fd9-891d-d6735cdbbe08 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:6f:7f:27:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:6f:7f:27:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:cc:58:b3:33:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 15:03:36.072507 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.072495 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 15:03:36.072627 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.072614 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 15:03:36.074576 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.074547 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 15:03:36.074705 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.074574 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 15:03:36.074754 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.074715 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 15:03:36.074754 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.074724 2574 container_manager_linux.go:306] "Creating device plugin manager" Jun 03 15:03:36.074754 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.074731 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:03:36.075545 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.075534 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 15:03:36.077246 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.077235 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:03:36.077351 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.077342 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 03 15:03:36.080743 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.080724 2574 kubelet.go:491] "Attempting to sync node with API server" Jun 03 15:03:36.080743 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.080740 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 15:03:36.080865 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.080751 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 15:03:36.080865 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.080760 2574 kubelet.go:397] "Adding apiserver pod source" Jun 03 15:03:36.080865 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.080769 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 15:03:36.081833 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.081822 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:03:36.081884 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.081840 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 15:03:36.083120 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.083103 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:03:36.084857 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.084833 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 03 15:03:36.087128 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.087115 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 15:03:36.089161 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089149 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 15:03:36.089205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089168 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 15:03:36.089205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089175 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 15:03:36.089205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089180 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 15:03:36.089205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089189 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 15:03:36.089205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089195 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 15:03:36.089205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089201 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 15:03:36.089205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089207 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 15:03:36.089384 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089214 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 15:03:36.089384 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089220 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 15:03:36.089384 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089228 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 15:03:36.089384 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.089234 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 15:03:36.090129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.090120 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 15:03:36.090158 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.090130 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 15:03:36.093194 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.093180 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 03 15:03:36.093265 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.093217 2574 server.go:1295] "Started kubelet" Jun 03 15:03:36.093318 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.093273 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 15:03:36.093381 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.093336 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 15:03:36.093419 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.093404 2574 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 03 15:03:36.093987 ip-10-0-133-0 systemd[1]: Started Kubernetes Kubelet. Jun 03 15:03:36.094671 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.094654 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 15:03:36.095389 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.095374 2574 server.go:317] "Adding debug handlers to kubelet server" Jun 03 15:03:36.098662 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.098642 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 15:03:36.099407 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.099383 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 15:03:36.099730 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.099709 2574 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 03 15:03:36.099730 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.099727 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 03 15:03:36.099861 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.099757 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 03 15:03:36.100544 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.100525 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 03 15:03:36.100544 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.100542 2574 reconciler.go:26] "Reconciler: start to sync state" Jun 03 15:03:36.101463 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.101430 2574 factory.go:55] Registering systemd factory Jun 03 15:03:36.101539 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.101475 2574 factory.go:223] Registration of the systemd container factory successfully Jun 03 15:03:36.101706 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.101690 2574 factory.go:153] Registering CRI-O factory Jun 03 15:03:36.101742 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.101710 2574 factory.go:223] Registration of the crio container factory successfully Jun 03 15:03:36.101780 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.101762 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 15:03:36.101831 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.101785 2574 factory.go:103] Registering Raw factory Jun 03 15:03:36.101831 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.101805 2574 manager.go:1196] Started watching for new ooms in manager Jun 03 15:03:36.102049 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.102029 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.102197 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.102183 2574 manager.go:319] Starting recovery of all containers Jun 03 15:03:36.104228 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.104201 2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 15:03:36.104321 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.104233 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 03 15:03:36.104321 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.104254 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 03 15:03:36.104460 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.104335 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 15:03:36.104514 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.104473 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 15:03:36.104623 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.104597 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 15:03:36.106725 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.104112 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-0.ec2.internal.18b59a6bf12ad2da default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-0.ec2.internal,UID:ip-10-0-133-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-0.ec2.internal,},FirstTimestamp:2026-06-03 15:03:36.093192922 +0000 UTC m=+0.416350215,LastTimestamp:2026-06-03 15:03:36.093192922 +0000 UTC m=+0.416350215,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-0.ec2.internal,}" Jun 03 15:03:36.115628 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.115436 2574 manager.go:324] Recovery completed Jun 03 15:03:36.119702 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.119688 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:36.121986 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.121966 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:36.122073 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.121994 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:36.122073 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.122004 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:36.122597 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.122580 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 15:03:36.122597 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.122597 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 15:03:36.122709 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.122612 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 03 15:03:36.124799 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.124667 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-0.ec2.internal.18b59a6bf2e224b3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-0.ec2.internal,UID:ip-10-0-133-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-0.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-0.ec2.internal,},FirstTimestamp:2026-06-03 15:03:36.121984179 +0000 UTC m=+0.445141473,LastTimestamp:2026-06-03 15:03:36.121984179 +0000 UTC m=+0.445141473,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-0.ec2.internal,}" Jun 03 15:03:36.124874 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.124852 2574 policy_none.go:49] "None policy: Start" Jun 03 15:03:36.124874 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.124869 2574 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 03 15:03:36.124944 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.124883 2574 state_mem.go:35] "Initializing new in-memory state store" Jun 03 15:03:36.134723 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.134660 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-0.ec2.internal.18b59a6bf2e25ea4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-0.ec2.internal,UID:ip-10-0-133-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-0.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-0.ec2.internal,},FirstTimestamp:2026-06-03 15:03:36.121999012 +0000 UTC m=+0.445156307,LastTimestamp:2026-06-03 15:03:36.121999012 +0000 UTC m=+0.445156307,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-0.ec2.internal,}" Jun 03 15:03:36.148681 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.148659 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s4b6c" Jun 03 15:03:36.153611 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.153545 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-0.ec2.internal.18b59a6bf2e283d6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-0.ec2.internal,UID:ip-10-0-133-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-133-0.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-133-0.ec2.internal,},FirstTimestamp:2026-06-03 15:03:36.122008534 +0000 UTC m=+0.445165828,LastTimestamp:2026-06-03 15:03:36.122008534 +0000 UTC m=+0.445165828,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-0.ec2.internal,}" Jun 03 15:03:36.156023 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.156011 2574 manager.go:341] "Starting Device Plugin manager" Jun 03 15:03:36.156079 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.156043 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 15:03:36.156079 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.156052 2574 server.go:85] "Starting device plugin registration server" Jun 03 15:03:36.156290 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.156276 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 15:03:36.156377 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.156290 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 15:03:36.156431 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.156383 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 15:03:36.157002 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.156566 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 15:03:36.157002 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.156579 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 15:03:36.157124 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.157036 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 15:03:36.157124 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.157075 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.165927 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.165905 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s4b6c" Jun 03 15:03:36.201851 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.201822 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 03 15:03:36.203223 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.203196 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 03 15:03:36.203337 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.203275 2574 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 03 15:03:36.203337 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.203319 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 15:03:36.203337 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.203326 2574 kubelet.go:2451] "Starting kubelet main sync loop" Jun 03 15:03:36.203493 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.203397 2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 15:03:36.206590 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.206573 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:36.256783 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.256695 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:36.257737 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.257709 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:36.257840 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.257747 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:36.257840 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.257763 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:36.257840 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.257789 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.303664 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.303637 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal"] Jun 03 15:03:36.303772 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.303713 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:36.304720 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.304704 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:36.304804 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.304735 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:36.304804 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.304754 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:36.306063 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.306050 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:36.306207 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.306191 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.306246 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.306223 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:36.308404 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.308380 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:36.308404 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.308394 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:36.308581 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.308418 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:36.308581 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.308422 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:36.308581 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.308432 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:36.308581 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.308437 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:36.309586 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.309570 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.309671 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.309598 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 03 15:03:36.310295 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.310275 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientMemory" Jun 03 15:03:36.310379 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.310303 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 15:03:36.310379 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.310312 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeHasSufficientPID" Jun 03 15:03:36.320618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.320601 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.320696 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.320622 2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-0.ec2.internal\": node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.334182 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.334158 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-0.ec2.internal\" not found" node="ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.338739 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.338722 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-0.ec2.internal\" not found" node="ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.402537 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.402511 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d995b3d7a98c9f98d9fa0e379217d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.ec2.internal\" (UID: \"4d995b3d7a98c9f98d9fa0e379217d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.402688 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.402543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3301cb62ffd43ea64420277922b649cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal\" (UID: \"3301cb62ffd43ea64420277922b649cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.402688 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.402562 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3301cb62ffd43ea64420277922b649cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal\" (UID: \"3301cb62ffd43ea64420277922b649cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.417799 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.417779 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.502863 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.502833 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d995b3d7a98c9f98d9fa0e379217d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.ec2.internal\" (UID: \"4d995b3d7a98c9f98d9fa0e379217d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.502946 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.502866 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3301cb62ffd43ea64420277922b649cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal\" (UID: \"3301cb62ffd43ea64420277922b649cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.502946 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.502892 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3301cb62ffd43ea64420277922b649cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal\" (UID: \"3301cb62ffd43ea64420277922b649cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.502946 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.502926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3301cb62ffd43ea64420277922b649cc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal\" (UID: \"3301cb62ffd43ea64420277922b649cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.502946 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.502928 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4d995b3d7a98c9f98d9fa0e379217d6a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-0.ec2.internal\" (UID: \"4d995b3d7a98c9f98d9fa0e379217d6a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.503063 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.502934 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3301cb62ffd43ea64420277922b649cc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal\" (UID: \"3301cb62ffd43ea64420277922b649cc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.517935 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.517881 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.618562 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.618523 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.636844 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.636804 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.641272 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.641254 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" Jun 03 15:03:36.718774 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.718738 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.819029 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.819005 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.919642 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:36.919607 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:36.989429 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:36.989273 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:37.013425 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.013403 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 15:03:37.013932 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.013557 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:03:37.013932 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.013605 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 15:03:37.020596 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:37.020570 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:37.101254 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.101233 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 15:03:37.110168 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:37.110138 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3301cb62ffd43ea64420277922b649cc.slice/crio-22fbae72d42f88ef69c356731a63c5a9db55683ec3afbf4228893d6ff3216cb0 WatchSource:0}: Error finding container 22fbae72d42f88ef69c356731a63c5a9db55683ec3afbf4228893d6ff3216cb0: Status 404 returned error can't find the container with id 22fbae72d42f88ef69c356731a63c5a9db55683ec3afbf4228893d6ff3216cb0 Jun 03 15:03:37.110524 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:37.110507 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d995b3d7a98c9f98d9fa0e379217d6a.slice/crio-69c2778851143f576eb05e28d0cf903fbbac072c4ec191c025dd2a2e2f9b32bd WatchSource:0}: Error finding container 69c2778851143f576eb05e28d0cf903fbbac072c4ec191c025dd2a2e2f9b32bd: Status 404 returned error can't find the container with id 69c2778851143f576eb05e28d0cf903fbbac072c4ec191c025dd2a2e2f9b32bd Jun 03 15:03:37.114621 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.114604 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:03:37.120948 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:37.120924 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-0.ec2.internal\" not found" Jun 03 15:03:37.122370 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.122354 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:37.167930 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.167886 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 14:58:36 +0000 UTC" deadline="2027-11-30 19:12:56.257108753 +0000 UTC" Jun 03 15:03:37.167930 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.167924 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13084h9m19.089191082s" Jun 03 15:03:37.201746 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.201714 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" Jun 03 15:03:37.206697 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.206651 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" event={"ID":"3301cb62ffd43ea64420277922b649cc","Type":"ContainerStarted","Data":"22fbae72d42f88ef69c356731a63c5a9db55683ec3afbf4228893d6ff3216cb0"} Jun 03 15:03:37.207592 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.207569 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" event={"ID":"4d995b3d7a98c9f98d9fa0e379217d6a","Type":"ContainerStarted","Data":"69c2778851143f576eb05e28d0cf903fbbac072c4ec191c025dd2a2e2f9b32bd"} Jun 03 15:03:37.218162 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.218142 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 15:03:37.269015 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.268982 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zbmrd" Jun 03 15:03:37.285903 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.285879 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:03:37.287639 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.287624 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" Jun 03 15:03:37.308550 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.308526 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zbmrd" Jun 03 15:03:37.343296 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.343262 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 15:03:37.691036 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:37.691005 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:38.082888 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.082861 2574 apiserver.go:52] "Watching apiserver" Jun 03 15:03:38.092473 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.092437 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 15:03:38.095566 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.095500 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-8gfc9","openshift-network-diagnostics/network-check-target-sd8kn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk","openshift-dns/node-resolver-fn9pw","openshift-multus/multus-additional-cni-plugins-pbgd7","openshift-network-operator/iptables-alerter-7z6vz","openshift-ovn-kubernetes/ovnkube-node-7h852","kube-system/konnectivity-agent-hgmns","kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal","openshift-cluster-node-tuning-operator/tuned-wgg7t","openshift-image-registry/node-ca-42xcc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal","openshift-multus/multus-8d6rh"] Jun 03 15:03:38.097528 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.097503 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.098601 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.098583 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:38.098691 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.098648 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:38.099803 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.099787 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.100857 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.100839 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.102080 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.102059 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.103156 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.103137 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.105460 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.105420 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:38.105555 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.105513 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:38.105555 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.105529 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:03:38.107807 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.107787 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.107889 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.107851 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.108871 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.108850 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.110973 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.110858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-systemd-units\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.110973 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.110894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-var-lib-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.110973 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.110917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-ovn\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.110973 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.110934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-registration-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.110973 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.110953 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.111240 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.110987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-kubelet\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111240 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-slash\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111240 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-etc-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111240 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111075 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111240 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111101 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovn-node-metrics-cert\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111240 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111125 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqbv9\" (UniqueName: \"kubernetes.io/projected/aa8de463-654d-4582-a9c6-76fa1dec361d-kube-api-access-tqbv9\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.111240 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111151 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcjmc\" (UniqueName: \"kubernetes.io/projected/04c78b61-5379-4edb-8c49-40f541af95ff-kube-api-access-fcjmc\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.111240 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-cni-bin\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-device-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-log-socket\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111316 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-socket-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04c78b61-5379-4edb-8c49-40f541af95ff-tmp-dir\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-cni-netd\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-run-netns\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89vm5\" (UniqueName: \"kubernetes.io/projected/b05f0926-3b3c-4130-9af5-7aac7591cdbd-kube-api-access-89vm5\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111516 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-sys-fs\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-systemd\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-node-log\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovnkube-script-lib\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.111580 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111587 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04c78b61-5379-4edb-8c49-40f541af95ff-hosts-file\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.112103 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovnkube-config\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.112103 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.111632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-env-overrides\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.115048 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115029 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 15:03:38.115187 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115169 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 15:03:38.115228 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115204 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 15:03:38.115265 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115228 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 15:03:38.115366 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115352 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 15:03:38.115421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115399 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 15:03:38.115533 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115401 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:38.115573 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115547 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 15:03:38.115627 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115612 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 15:03:38.115734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115720 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 15:03:38.115995 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.115981 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 15:03:38.116089 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116074 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 15:03:38.116089 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116083 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 15:03:38.116337 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116317 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 15:03:38.116420 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116353 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 15:03:38.116420 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116362 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 15:03:38.116420 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116410 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 15:03:38.116585 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116437 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:38.116658 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116641 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 15:03:38.116736 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116716 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 15:03:38.116836 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116776 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 15:03:38.116836 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116783 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7hbbw\"" Jun 03 15:03:38.116836 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116788 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 15:03:38.116836 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116803 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m7txf\"" Jun 03 15:03:38.117030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116863 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:03:38.117030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116894 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bl5r5\"" Jun 03 15:03:38.117030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116909 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 15:03:38.117030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.116926 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 15:03:38.117030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.117005 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gwtcb\"" Jun 03 15:03:38.117264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.117126 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cs7cd\"" Jun 03 15:03:38.117264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.117227 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g92qj\"" Jun 03 15:03:38.117432 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.117412 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-c4hsh\"" Jun 03 15:03:38.117549 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.117473 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-24t6r\"" Jun 03 15:03:38.117549 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.117509 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5vrj8\"" Jun 03 15:03:38.117773 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.117748 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 15:03:38.118413 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.118398 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 15:03:38.201477 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.201367 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 03 15:03:38.212503 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-run\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.212673 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212513 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-run-netns\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.212673 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212535 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-os-release\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.212673 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-k8s-cni-cncf-io\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.212673 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-conf-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.212673 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-run-netns\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.212673 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212611 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovnkube-script-lib\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.212673 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-iptables-alerter-script\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.212673 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysctl-conf\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212684 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04c78b61-5379-4edb-8c49-40f541af95ff-hosts-file\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212708 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovnkube-config\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-systemd\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/838870cc-054b-4351-8726-085724a193c2-etc-tuned\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212776 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-systemd-units\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212800 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-var-lib-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212824 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-ovn\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212852 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-registration-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212875 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-host\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmnh7\" (UniqueName: \"kubernetes.io/projected/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-kube-api-access-pmnh7\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-cnibin\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-sys\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.212995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-lib-modules\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.213031 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213019 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-slash\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213043 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovn-node-metrics-cert\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213089 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213121 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fcjmc\" (UniqueName: \"kubernetes.io/projected/04c78b61-5379-4edb-8c49-40f541af95ff-kube-api-access-fcjmc\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213147 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-cni-bin\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213175 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-systemd-units\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213193 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-device-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-registration-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-cni-multus\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213220 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-var-lib-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213241 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-ovn\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213254 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-log-socket\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovnkube-config\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213282 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovnkube-script-lib\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213297 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-etc-selinux\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213298 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/04c78b61-5379-4edb-8c49-40f541af95ff-hosts-file\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213285 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-socket-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.213722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213361 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-device-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-socket-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-kubelet\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-daemon-config\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-cni-bin\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213430 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04c78b61-5379-4edb-8c49-40f541af95ff-tmp-dir\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-log-socket\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213496 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213497 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-slash\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213527 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-cni-netd\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213562 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysctl-d\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-cni-netd\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213693 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04c78b61-5379-4edb-8c49-40f541af95ff-tmp-dir\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-socket-dir-parent\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-etc-kubernetes\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.214536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213806 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-89vm5\" (UniqueName: \"kubernetes.io/projected/b05f0926-3b3c-4130-9af5-7aac7591cdbd-kube-api-access-89vm5\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213841 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-sys-fs\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213859 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-system-cni-dir\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7wsk\" (UniqueName: \"kubernetes.io/projected/2d264119-1673-43ed-817f-de832fc810c9-kube-api-access-p7wsk\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213919 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-host\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213938 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-sys-fs\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213942 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0c5d0aa-a851-4211-aff4-de66208c444b-agent-certs\") pod \"konnectivity-agent-hgmns\" (UID: \"a0c5d0aa-a851-4211-aff4-de66208c444b\") " pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.213995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0c5d0aa-a851-4211-aff4-de66208c444b-konnectivity-ca\") pod \"konnectivity-agent-hgmns\" (UID: \"a0c5d0aa-a851-4211-aff4-de66208c444b\") " pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-serviceca\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214061 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-systemd\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214085 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-node-log\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-hostroot\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv69f\" (UniqueName: \"kubernetes.io/projected/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-kube-api-access-sv69f\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214152 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-node-log\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214149 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-run-systemd\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214175 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-env-overrides\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-system-cni-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.215421 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214223 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-cni-bin\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214274 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-kubelet\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214339 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-kubelet\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214385 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-etc-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214416 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214459 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqbv9\" (UniqueName: \"kubernetes.io/projected/aa8de463-654d-4582-a9c6-76fa1dec361d-kube-api-access-tqbv9\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-etc-openvswitch\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214489 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn8hp\" (UniqueName: \"kubernetes.io/projected/0d75de24-f4bf-4127-b84e-cf5288119dd4-kube-api-access-kn8hp\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214525 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-modprobe-d\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214563 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-run-ovn-kubernetes\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/838870cc-054b-4351-8726-085724a193c2-tmp\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-netns\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b05f0926-3b3c-4130-9af5-7aac7591cdbd-env-overrides\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214636 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-cnibin\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.216109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214667 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b05f0926-3b3c-4130-9af5-7aac7591cdbd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214708 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l52mb\" (UniqueName: \"kubernetes.io/projected/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-kube-api-access-l52mb\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-var-lib-kubelet\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9k85\" (UniqueName: \"kubernetes.io/projected/838870cc-054b-4351-8726-085724a193c2-kube-api-access-p9k85\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-multus-certs\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214774 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214793 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-host-slash\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-kubernetes\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-cni-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214934 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-cni-binary-copy\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.214991 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.215067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/aa8de463-654d-4582-a9c6-76fa1dec361d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.215165 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-os-release\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.216790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.215190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysconfig\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.217461 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.217427 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b05f0926-3b3c-4130-9af5-7aac7591cdbd-ovn-node-metrics-cert\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.240029 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.240002 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcjmc\" (UniqueName: \"kubernetes.io/projected/04c78b61-5379-4edb-8c49-40f541af95ff-kube-api-access-fcjmc\") pod \"node-resolver-fn9pw\" (UID: \"04c78b61-5379-4edb-8c49-40f541af95ff\") " pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.240514 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.240491 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:38.240625 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.240520 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:38.240625 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.240533 2574 projected.go:194] Error preparing data for projected volume kube-api-access-gwfw2 for pod openshift-network-diagnostics/network-check-target-sd8kn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:38.240625 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.240612 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2 podName:9664909d-7a2f-4179-b4cd-87b857dad196 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:38.740578731 +0000 UTC m=+3.063736016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gwfw2" (UniqueName: "kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2") pod "network-check-target-sd8kn" (UID: "9664909d-7a2f-4179-b4cd-87b857dad196") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:38.241664 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.241644 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqbv9\" (UniqueName: \"kubernetes.io/projected/aa8de463-654d-4582-a9c6-76fa1dec361d-kube-api-access-tqbv9\") pod \"aws-ebs-csi-driver-node-j6qsk\" (UID: \"aa8de463-654d-4582-a9c6-76fa1dec361d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.242372 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.242354 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89vm5\" (UniqueName: \"kubernetes.io/projected/b05f0926-3b3c-4130-9af5-7aac7591cdbd-kube-api-access-89vm5\") pod \"ovnkube-node-7h852\" (UID: \"b05f0926-3b3c-4130-9af5-7aac7591cdbd\") " pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.310162 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.310124 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:58:37 +0000 UTC" deadline="2027-11-18 03:48:39.699944154 +0000 UTC" Jun 03 15:03:38.310162 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.310157 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12780h45m1.389789905s" Jun 03 15:03:38.315906 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.315855 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.315906 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.315897 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kn8hp\" (UniqueName: \"kubernetes.io/projected/0d75de24-f4bf-4127-b84e-cf5288119dd4-kube-api-access-kn8hp\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.315906 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.315920 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-modprobe-d\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.315942 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/838870cc-054b-4351-8726-085724a193c2-tmp\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.315962 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-netns\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.315985 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-cnibin\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316010 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316034 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l52mb\" (UniqueName: \"kubernetes.io/projected/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-kube-api-access-l52mb\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316047 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316070 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-var-lib-kubelet\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316095 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9k85\" (UniqueName: \"kubernetes.io/projected/838870cc-054b-4351-8726-085724a193c2-kube-api-access-p9k85\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316100 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-netns\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316119 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-multus-certs\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316157 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-host-slash\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.316189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316181 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316204 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-kubernetes\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316228 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-cni-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316254 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-cni-binary-copy\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316281 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-os-release\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316304 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysconfig\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316329 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-run\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316355 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-os-release\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316378 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-modprobe-d\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316379 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-k8s-cni-cncf-io\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316421 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-conf-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316428 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-k8s-cni-cncf-io\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316462 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-iptables-alerter-script\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316485 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysctl-conf\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-cnibin\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316505 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-systemd\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316541 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/838870cc-054b-4351-8726-085724a193c2-etc-tuned\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316570 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-host\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.316774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316588 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmnh7\" (UniqueName: \"kubernetes.io/projected/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-kube-api-access-pmnh7\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316609 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-cnibin\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316632 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-sys\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316649 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-lib-modules\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316671 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316700 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-cni-multus\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316720 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316735 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-kubelet\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316755 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-daemon-config\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316783 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysctl-d\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316805 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-socket-dir-parent\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316831 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-etc-kubernetes\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316861 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-system-cni-dir\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316881 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p7wsk\" (UniqueName: \"kubernetes.io/projected/2d264119-1673-43ed-817f-de832fc810c9-kube-api-access-p7wsk\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316897 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-host\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316934 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0c5d0aa-a851-4211-aff4-de66208c444b-agent-certs\") pod \"konnectivity-agent-hgmns\" (UID: \"a0c5d0aa-a851-4211-aff4-de66208c444b\") " pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316953 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0c5d0aa-a851-4211-aff4-de66208c444b-konnectivity-ca\") pod \"konnectivity-agent-hgmns\" (UID: \"a0c5d0aa-a851-4211-aff4-de66208c444b\") " pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:03:38.317618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316970 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-serviceca\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.316986 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-hostroot\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317012 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sv69f\" (UniqueName: \"kubernetes.io/projected/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-kube-api-access-sv69f\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317028 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-system-cni-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-cni-binary-copy\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317048 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-cni-bin\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317121 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-cni-bin\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317283 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-var-lib-kubelet\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317405 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-cni-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-run-multus-certs\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-kubernetes\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-kubelet\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-host\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-sys\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317621 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysctl-d\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317629 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-run\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-cnibin\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-socket-dir-parent\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.318334 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysconfig\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317692 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-os-release\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.317733 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-etc-kubernetes\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-lib-modules\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317782 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-system-cni-dir\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.317804 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs podName:2d264119-1673-43ed-817f-de832fc810c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:38.817785538 +0000 UTC m=+3.140942839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs") pod "network-metrics-daemon-8gfc9" (UID: "2d264119-1673-43ed-817f-de832fc810c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317560 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0d75de24-f4bf-4127-b84e-cf5288119dd4-os-release\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317927 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-iptables-alerter-script\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.317940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-systemd\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318057 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/838870cc-054b-4351-8726-085724a193c2-etc-sysctl-conf\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318261 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-host-var-lib-cni-multus\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318330 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318334 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-hostroot\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318366 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-serviceca\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318406 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-conf-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-system-cni-dir\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.319129 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318646 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0d75de24-f4bf-4127-b84e-cf5288119dd4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.320025 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318649 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-host-slash\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.320025 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318703 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-host\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.320025 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.318950 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-cni-binary-copy\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.320025 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.319125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a0c5d0aa-a851-4211-aff4-de66208c444b-konnectivity-ca\") pod \"konnectivity-agent-hgmns\" (UID: \"a0c5d0aa-a851-4211-aff4-de66208c444b\") " pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:03:38.320025 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.319471 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-multus-daemon-config\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.320025 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.319906 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/838870cc-054b-4351-8726-085724a193c2-tmp\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.320586 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.320534 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/838870cc-054b-4351-8726-085724a193c2-etc-tuned\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.321191 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.321170 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a0c5d0aa-a851-4211-aff4-de66208c444b-agent-certs\") pod \"konnectivity-agent-hgmns\" (UID: \"a0c5d0aa-a851-4211-aff4-de66208c444b\") " pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:03:38.337727 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.337665 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn8hp\" (UniqueName: \"kubernetes.io/projected/0d75de24-f4bf-4127-b84e-cf5288119dd4-kube-api-access-kn8hp\") pod \"multus-additional-cni-plugins-pbgd7\" (UID: \"0d75de24-f4bf-4127-b84e-cf5288119dd4\") " pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.347217 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.347186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7wsk\" (UniqueName: \"kubernetes.io/projected/2d264119-1673-43ed-817f-de832fc810c9-kube-api-access-p7wsk\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:38.347349 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.347273 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9k85\" (UniqueName: \"kubernetes.io/projected/838870cc-054b-4351-8726-085724a193c2-kube-api-access-p9k85\") pod \"tuned-wgg7t\" (UID: \"838870cc-054b-4351-8726-085724a193c2\") " pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.347666 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.347648 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l52mb\" (UniqueName: \"kubernetes.io/projected/87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5-kube-api-access-l52mb\") pod \"iptables-alerter-7z6vz\" (UID: \"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5\") " pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.347948 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.347926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv69f\" (UniqueName: \"kubernetes.io/projected/06fbd415-d46a-4f1a-bb7b-dfa988b6706c-kube-api-access-sv69f\") pod \"multus-8d6rh\" (UID: \"06fbd415-d46a-4f1a-bb7b-dfa988b6706c\") " pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.349051 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.349031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmnh7\" (UniqueName: \"kubernetes.io/projected/eb9ee7ed-f607-49c8-a1d4-51d74b749ae7-kube-api-access-pmnh7\") pod \"node-ca-42xcc\" (UID: \"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7\") " pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.411022 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.410986 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:03:38.416802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.416779 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:38.418086 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.418068 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" Jun 03 15:03:38.427142 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.427118 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" Jun 03 15:03:38.432748 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.432728 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fn9pw" Jun 03 15:03:38.439882 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.439860 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7z6vz" Jun 03 15:03:38.446736 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.446713 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:03:38.452361 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.452339 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" Jun 03 15:03:38.459016 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.458993 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-42xcc" Jun 03 15:03:38.463814 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.463797 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8d6rh" Jun 03 15:03:38.503485 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:38.503246 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9ee7ed_f607_49c8_a1d4_51d74b749ae7.slice/crio-b93b1644fca5b6f4c063fc0f8225b1342af445f5c6d78a6f0ac18cfd39eca97e WatchSource:0}: Error finding container b93b1644fca5b6f4c063fc0f8225b1342af445f5c6d78a6f0ac18cfd39eca97e: Status 404 returned error can't find the container with id b93b1644fca5b6f4c063fc0f8225b1342af445f5c6d78a6f0ac18cfd39eca97e Jun 03 15:03:38.511054 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:38.510986 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c5d0aa_a851_4211_aff4_de66208c444b.slice/crio-95702eaecffe0d2361c3b06925905dc4ddb71b983c40ca19786d403b70bb4a74 WatchSource:0}: Error finding container 95702eaecffe0d2361c3b06925905dc4ddb71b983c40ca19786d403b70bb4a74: Status 404 returned error can't find the container with id 95702eaecffe0d2361c3b06925905dc4ddb71b983c40ca19786d403b70bb4a74 Jun 03 15:03:38.511987 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:38.511967 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa8de463_654d_4582_a9c6_76fa1dec361d.slice/crio-4c0af3c33d858c43ca4a1057fcb987149bdf1613fac18312c745d1519700650d WatchSource:0}: Error finding container 4c0af3c33d858c43ca4a1057fcb987149bdf1613fac18312c745d1519700650d: Status 404 returned error can't find the container with id 4c0af3c33d858c43ca4a1057fcb987149bdf1613fac18312c745d1519700650d Jun 03 15:03:38.512867 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:38.512638 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d75de24_f4bf_4127_b84e_cf5288119dd4.slice/crio-4e01bc9d37dc03854b99083d698b9430750ea119b98bbc6eb856f1fb1a961a7e WatchSource:0}: Error finding container 4e01bc9d37dc03854b99083d698b9430750ea119b98bbc6eb856f1fb1a961a7e: Status 404 returned error can't find the container with id 4e01bc9d37dc03854b99083d698b9430750ea119b98bbc6eb856f1fb1a961a7e Jun 03 15:03:38.513689 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:03:38.513662 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod838870cc_054b_4351_8726_085724a193c2.slice/crio-d56d74773a8e6abd392b21d9aff87d0d952ba81477c37ad94c2e969528f1d9aa WatchSource:0}: Error finding container d56d74773a8e6abd392b21d9aff87d0d952ba81477c37ad94c2e969528f1d9aa: Status 404 returned error can't find the container with id d56d74773a8e6abd392b21d9aff87d0d952ba81477c37ad94c2e969528f1d9aa Jun 03 15:03:38.821429 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.821392 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:38.821636 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:38.821436 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:38.821636 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.821570 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:38.821636 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.821575 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:38.821636 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.821595 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:38.821636 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.821607 2574 projected.go:194] Error preparing data for projected volume kube-api-access-gwfw2 for pod openshift-network-diagnostics/network-check-target-sd8kn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:38.821846 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.821678 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs podName:2d264119-1673-43ed-817f-de832fc810c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:39.821657161 +0000 UTC m=+4.144814447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs") pod "network-metrics-daemon-8gfc9" (UID: "2d264119-1673-43ed-817f-de832fc810c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:38.821846 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:38.821700 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2 podName:9664909d-7a2f-4179-b4cd-87b857dad196 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:39.821690582 +0000 UTC m=+4.144847865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwfw2" (UniqueName: "kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2") pod "network-check-target-sd8kn" (UID: "9664909d-7a2f-4179-b4cd-87b857dad196") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:39.095348 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.095137 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 15:03:39.215204 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.215122 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-42xcc" event={"ID":"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7","Type":"ContainerStarted","Data":"b93b1644fca5b6f4c063fc0f8225b1342af445f5c6d78a6f0ac18cfd39eca97e"} Jun 03 15:03:39.227130 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.227079 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" event={"ID":"4d995b3d7a98c9f98d9fa0e379217d6a","Type":"ContainerStarted","Data":"a33a5d5941ce8051c0b34765564402e6b2e1764d1e5450653ff8e85a6cd4cf7a"} Jun 03 15:03:39.230953 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.230912 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8d6rh" event={"ID":"06fbd415-d46a-4f1a-bb7b-dfa988b6706c","Type":"ContainerStarted","Data":"750c01c5a58b31cce7a5461f3628209b4c626330faac8cfd20743a9d1444fe07"} Jun 03 15:03:39.240743 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.240710 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"87919c720129143c672ddf02194b8500c15ad6f1e17667e659fb61191af8d182"} Jun 03 15:03:39.247128 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.247099 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" event={"ID":"aa8de463-654d-4582-a9c6-76fa1dec361d","Type":"ContainerStarted","Data":"4c0af3c33d858c43ca4a1057fcb987149bdf1613fac18312c745d1519700650d"} Jun 03 15:03:39.249188 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.249162 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hgmns" event={"ID":"a0c5d0aa-a851-4211-aff4-de66208c444b","Type":"ContainerStarted","Data":"95702eaecffe0d2361c3b06925905dc4ddb71b983c40ca19786d403b70bb4a74"} Jun 03 15:03:39.251530 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.251508 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7z6vz" event={"ID":"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5","Type":"ContainerStarted","Data":"7416425c27ae85db980a77448ce130a60e4131c91c0474bde17041144b76c674"} Jun 03 15:03:39.276956 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.276881 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" event={"ID":"0d75de24-f4bf-4127-b84e-cf5288119dd4","Type":"ContainerStarted","Data":"4e01bc9d37dc03854b99083d698b9430750ea119b98bbc6eb856f1fb1a961a7e"} Jun 03 15:03:39.287724 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.287684 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fn9pw" event={"ID":"04c78b61-5379-4edb-8c49-40f541af95ff","Type":"ContainerStarted","Data":"1e9c055952010f9afcc69e528225808f5d576ba48c59d2c70335404a97305463"} Jun 03 15:03:39.299459 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.299396 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" event={"ID":"838870cc-054b-4351-8726-085724a193c2","Type":"ContainerStarted","Data":"d56d74773a8e6abd392b21d9aff87d0d952ba81477c37ad94c2e969528f1d9aa"} Jun 03 15:03:39.314735 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.314544 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:58:37 +0000 UTC" deadline="2027-11-09 15:41:39.375328945 +0000 UTC" Jun 03 15:03:39.314735 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.314583 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12576h38m0.060750508s" Jun 03 15:03:39.829208 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.829171 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:39.829381 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:39.829223 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:39.829477 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:39.829378 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:39.829477 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:39.829459 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs podName:2d264119-1673-43ed-817f-de832fc810c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:41.829421104 +0000 UTC m=+6.152578386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs") pod "network-metrics-daemon-8gfc9" (UID: "2d264119-1673-43ed-817f-de832fc810c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:39.829915 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:39.829895 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:39.829984 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:39.829920 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:39.829984 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:39.829935 2574 projected.go:194] Error preparing data for projected volume kube-api-access-gwfw2 for pod openshift-network-diagnostics/network-check-target-sd8kn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:39.829984 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:39.829981 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2 podName:9664909d-7a2f-4179-b4cd-87b857dad196 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:41.829966562 +0000 UTC m=+6.153123846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwfw2" (UniqueName: "kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2") pod "network-check-target-sd8kn" (UID: "9664909d-7a2f-4179-b4cd-87b857dad196") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:40.203949 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:40.203869 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:40.204399 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:40.203999 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:40.206654 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:40.206631 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:40.206779 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:40.206743 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:41.012206 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.012149 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-0.ec2.internal" podStartSLOduration=4.012116775 podStartE2EDuration="4.012116775s" podCreationTimestamp="2026-06-03 15:03:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:03:39.276724244 +0000 UTC m=+3.599881549" watchObservedRunningTime="2026-06-03 15:03:41.012116775 +0000 UTC m=+5.335274079" Jun 03 15:03:41.012882 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.012857 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wdhf8"] Jun 03 15:03:41.014782 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.014761 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.014896 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.014837 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:41.039098 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.039068 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2039603c-658b-453a-a073-7870997f32a5-kubelet-config\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.039257 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.039115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.039257 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.039185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2039603c-658b-453a-a073-7870997f32a5-dbus\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.141091 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.140407 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2039603c-658b-453a-a073-7870997f32a5-kubelet-config\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.141091 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.140469 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.141091 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.140541 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2039603c-658b-453a-a073-7870997f32a5-dbus\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.141091 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.140672 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2039603c-658b-453a-a073-7870997f32a5-dbus\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.141091 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.140730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2039603c-658b-453a-a073-7870997f32a5-kubelet-config\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.141091 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.140819 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:41.141091 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.140875 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret podName:2039603c-658b-453a-a073-7870997f32a5 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:41.640857493 +0000 UTC m=+5.964014777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret") pod "global-pull-secret-syncer-wdhf8" (UID: "2039603c-658b-453a-a073-7870997f32a5") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:41.645973 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.645939 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:41.646391 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.646072 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:41.646391 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.646135 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret podName:2039603c-658b-453a-a073-7870997f32a5 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:42.646117576 +0000 UTC m=+6.969274865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret") pod "global-pull-secret-syncer-wdhf8" (UID: "2039603c-658b-453a-a073-7870997f32a5") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:41.847701 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.847664 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:41.847883 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:41.847714 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:41.847883 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.847828 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:41.847883 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.847835 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:41.847883 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.847865 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:41.847883 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.847879 2574 projected.go:194] Error preparing data for projected volume kube-api-access-gwfw2 for pod openshift-network-diagnostics/network-check-target-sd8kn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:41.848135 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.847890 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs podName:2d264119-1673-43ed-817f-de832fc810c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:45.847872629 +0000 UTC m=+10.171029914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs") pod "network-metrics-daemon-8gfc9" (UID: "2d264119-1673-43ed-817f-de832fc810c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:41.848135 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:41.847931 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2 podName:9664909d-7a2f-4179-b4cd-87b857dad196 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:45.847914391 +0000 UTC m=+10.171071690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwfw2" (UniqueName: "kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2") pod "network-check-target-sd8kn" (UID: "9664909d-7a2f-4179-b4cd-87b857dad196") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:42.204052 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:42.204019 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:42.204245 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:42.204195 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:42.204872 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:42.204567 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:42.204872 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:42.204709 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:42.654614 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:42.654572 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:42.655064 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:42.654732 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:42.655064 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:42.654810 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret podName:2039603c-658b-453a-a073-7870997f32a5 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:44.654789853 +0000 UTC m=+8.977947133 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret") pod "global-pull-secret-syncer-wdhf8" (UID: "2039603c-658b-453a-a073-7870997f32a5") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:43.204745 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:43.204458 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:43.204745 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:43.204591 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:44.204430 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:44.204241 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:44.204889 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:44.204369 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:44.211484 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:44.210613 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:44.211484 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:44.210782 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:44.673181 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:44.673139 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:44.673379 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:44.673319 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:44.673434 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:44.673389 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret podName:2039603c-658b-453a-a073-7870997f32a5 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:48.673368341 +0000 UTC m=+12.996525673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret") pod "global-pull-secret-syncer-wdhf8" (UID: "2039603c-658b-453a-a073-7870997f32a5") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:45.204361 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:45.203922 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:45.204361 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:45.204032 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:45.884264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:45.883655 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:45.884264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:45.883706 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:45.884264 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:45.883813 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:45.884264 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:45.883840 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:45.884264 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:45.883854 2574 projected.go:194] Error preparing data for projected volume kube-api-access-gwfw2 for pod openshift-network-diagnostics/network-check-target-sd8kn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:45.884264 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:45.883855 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:45.884264 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:45.883918 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs podName:2d264119-1673-43ed-817f-de832fc810c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:53.883898733 +0000 UTC m=+18.207056019 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs") pod "network-metrics-daemon-8gfc9" (UID: "2d264119-1673-43ed-817f-de832fc810c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:45.884264 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:45.883936 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2 podName:9664909d-7a2f-4179-b4cd-87b857dad196 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:53.883925987 +0000 UTC m=+18.207083273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwfw2" (UniqueName: "kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2") pod "network-check-target-sd8kn" (UID: "9664909d-7a2f-4179-b4cd-87b857dad196") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:46.204391 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:46.204306 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:46.204662 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:46.204404 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:46.204662 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:46.204481 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:46.204662 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:46.204590 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:47.204192 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:47.204159 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:47.204366 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:47.204298 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:48.204189 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:48.204109 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:48.204579 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:48.204127 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:48.204579 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:48.204228 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:48.204579 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:48.204314 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:48.707740 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:48.707621 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:48.707976 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:48.707789 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:48.707976 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:48.707866 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret podName:2039603c-658b-453a-a073-7870997f32a5 nodeName:}" failed. No retries permitted until 2026-06-03 15:03:56.707848183 +0000 UTC m=+21.031005465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret") pod "global-pull-secret-syncer-wdhf8" (UID: "2039603c-658b-453a-a073-7870997f32a5") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:49.204182 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:49.204144 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:49.204362 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:49.204285 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:50.203712 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:50.203676 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:50.203886 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:50.203795 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:50.203886 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:50.203856 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:50.203986 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:50.203955 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:51.203765 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:51.203725 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:51.204160 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:51.203846 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:52.204636 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:52.204604 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:52.204994 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:52.204615 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:52.204994 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:52.204747 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:52.204994 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:52.204839 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:53.203782 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:53.203744 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:53.203945 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:53.203874 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:53.946727 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:53.946684 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:53.947156 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:53.946741 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:53.947156 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:53.946882 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:03:53.947156 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:53.946890 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:53.947156 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:53.946908 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:03:53.947156 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:53.946923 2574 projected.go:194] Error preparing data for projected volume kube-api-access-gwfw2 for pod openshift-network-diagnostics/network-check-target-sd8kn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:53.947156 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:53.946962 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs podName:2d264119-1673-43ed-817f-de832fc810c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:09.946941855 +0000 UTC m=+34.270099141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs") pod "network-metrics-daemon-8gfc9" (UID: "2d264119-1673-43ed-817f-de832fc810c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:03:53.947156 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:53.946981 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2 podName:9664909d-7a2f-4179-b4cd-87b857dad196 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:09.946970429 +0000 UTC m=+34.270127713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwfw2" (UniqueName: "kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2") pod "network-check-target-sd8kn" (UID: "9664909d-7a2f-4179-b4cd-87b857dad196") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:03:54.204134 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:54.204044 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:54.204289 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:54.204049 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:54.204289 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:54.204179 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:54.204418 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:54.204283 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:55.203998 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:55.203965 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:55.204403 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:55.204076 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:56.205396 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:56.205178 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:56.205905 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:56.205261 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:56.205905 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:56.205509 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:56.205905 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:56.205603 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:56.767062 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:56.767018 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:56.767239 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:56.767163 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:56.767239 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:56.767232 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret podName:2039603c-658b-453a-a073-7870997f32a5 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:12.767216806 +0000 UTC m=+37.090374099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret") pod "global-pull-secret-syncer-wdhf8" (UID: "2039603c-658b-453a-a073-7870997f32a5") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:03:57.204540 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:57.203810 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:57.204540 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:57.203928 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:57.335525 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:57.335485 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" event={"ID":"838870cc-054b-4351-8726-085724a193c2","Type":"ContainerStarted","Data":"47fb9be80906a3dd6fadec7358f7397d5b1c7ff67aec33988d20cf2a5f75ad51"} Jun 03 15:03:57.336905 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:57.336876 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8d6rh" event={"ID":"06fbd415-d46a-4f1a-bb7b-dfa988b6706c","Type":"ContainerStarted","Data":"202e8114f1aab18a71d228739edd82813435621e5ac1dd744b772f81887c81cc"} Jun 03 15:03:57.338376 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:57.338350 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"632619da5208fd1e5cf794d02467ba4441bf4fde52bfd65e3f81d81440de3933"} Jun 03 15:03:57.395901 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:57.395847 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wgg7t" podStartSLOduration=2.927119592 podStartE2EDuration="21.395830294s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.517552137 +0000 UTC m=+2.840709424" lastFinishedPulling="2026-06-03 15:03:56.986262844 +0000 UTC m=+21.309420126" observedRunningTime="2026-06-03 15:03:57.395512423 +0000 UTC m=+21.718669729" watchObservedRunningTime="2026-06-03 15:03:57.395830294 +0000 UTC m=+21.718987596" Jun 03 15:03:58.203851 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.203688 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:03:58.203988 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.203741 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:03:58.203988 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:58.203957 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:03:58.204100 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:58.204076 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:03:58.342560 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.342355 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:03:58.342878 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.342835 2574 generic.go:358] "Generic (PLEG): container finished" podID="b05f0926-3b3c-4130-9af5-7aac7591cdbd" containerID="de463f71c7f38bed153c187424cbdea032ec270f367de617a21a1117edbf9c57" exitCode=1 Jun 03 15:03:58.342920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.342905 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"3658fc838cae15cbb32738ae582751295086fed0572645b36d0311e76fa1d95f"} Jun 03 15:03:58.342951 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.342932 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"2828f2af07ccfdb333c253cc29ba3b9b07bddb490b891cab9a06a9c43dfc1acb"} Jun 03 15:03:58.342951 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.342941 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"2ed8b3b9884269be70fbe1cbc9ef74f2a32a29ab5ed6386b7d779e66dd431a1a"} Jun 03 15:03:58.342951 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.342949 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"15bfcabfdd5f6bd195d244198511b578aa45ba0f729b7343a2175e5ede8c6aaa"} Jun 03 15:03:58.343039 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.342957 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerDied","Data":"de463f71c7f38bed153c187424cbdea032ec270f367de617a21a1117edbf9c57"} Jun 03 15:03:58.344048 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.344030 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" event={"ID":"aa8de463-654d-4582-a9c6-76fa1dec361d","Type":"ContainerStarted","Data":"551c5b16c896dd0dc56933ee06c95e48e59576c136d151d7637569ad1222d741"} Jun 03 15:03:58.345122 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.345101 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hgmns" event={"ID":"a0c5d0aa-a851-4211-aff4-de66208c444b","Type":"ContainerStarted","Data":"12eab7404a3418982118a2738113d79cec7e7dbbcb926d1203a4197b2aed3ae6"} Jun 03 15:03:58.347264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.347246 2574 generic.go:358] "Generic (PLEG): container finished" podID="0d75de24-f4bf-4127-b84e-cf5288119dd4" containerID="158f0137b14d3946ca40d70ef6dea0c113e21fda274892e59c688c77f8fe61ab" exitCode=0 Jun 03 15:03:58.347362 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.347301 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" event={"ID":"0d75de24-f4bf-4127-b84e-cf5288119dd4","Type":"ContainerDied","Data":"158f0137b14d3946ca40d70ef6dea0c113e21fda274892e59c688c77f8fe61ab"} Jun 03 15:03:58.348601 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.348581 2574 generic.go:358] "Generic (PLEG): container finished" podID="3301cb62ffd43ea64420277922b649cc" containerID="37d8c04aba581053f986e108e59da136ca19b1b02fe05d548048bc27a1bf8f67" exitCode=0 Jun 03 15:03:58.348675 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.348636 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" event={"ID":"3301cb62ffd43ea64420277922b649cc","Type":"ContainerDied","Data":"37d8c04aba581053f986e108e59da136ca19b1b02fe05d548048bc27a1bf8f67"} Jun 03 15:03:58.349884 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.349853 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fn9pw" event={"ID":"04c78b61-5379-4edb-8c49-40f541af95ff","Type":"ContainerStarted","Data":"bf668f588632fb5456cbb20bfd28cab742fc204784c9637ed9aea2773f9ea1a4"} Jun 03 15:03:58.350959 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.350939 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-42xcc" event={"ID":"eb9ee7ed-f607-49c8-a1d4-51d74b749ae7","Type":"ContainerStarted","Data":"555199b5f4acf3a706b8c26afd1dcda77473be021af7d62d29b377e02da90eca"} Jun 03 15:03:58.404074 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.403967 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-8d6rh" podStartSLOduration=3.89630384 podStartE2EDuration="22.403951059s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.518050294 +0000 UTC m=+2.841207576" lastFinishedPulling="2026-06-03 15:03:57.025697515 +0000 UTC m=+21.348854795" observedRunningTime="2026-06-03 15:03:57.44169911 +0000 UTC m=+21.764856414" watchObservedRunningTime="2026-06-03 15:03:58.403951059 +0000 UTC m=+22.727108363" Jun 03 15:03:58.404692 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.404663 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hgmns" podStartSLOduration=3.931264033 podStartE2EDuration="22.404652786s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.512835033 +0000 UTC m=+2.835992315" lastFinishedPulling="2026-06-03 15:03:56.986223786 +0000 UTC m=+21.309381068" observedRunningTime="2026-06-03 15:03:58.404072122 +0000 UTC m=+22.727229427" watchObservedRunningTime="2026-06-03 15:03:58.404652786 +0000 UTC m=+22.727810088" Jun 03 15:03:58.511277 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.511232 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fn9pw" podStartSLOduration=4.045027227 podStartE2EDuration="22.511213312s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.520036364 +0000 UTC m=+2.843193644" lastFinishedPulling="2026-06-03 15:03:56.986222444 +0000 UTC m=+21.309379729" observedRunningTime="2026-06-03 15:03:58.452814124 +0000 UTC m=+22.775971427" watchObservedRunningTime="2026-06-03 15:03:58.511213312 +0000 UTC m=+22.834370807" Jun 03 15:03:58.548093 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:58.548047 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-42xcc" podStartSLOduration=4.068141328 podStartE2EDuration="22.548033221s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.506356939 +0000 UTC m=+2.829514238" lastFinishedPulling="2026-06-03 15:03:56.986248837 +0000 UTC m=+21.309406131" observedRunningTime="2026-06-03 15:03:58.547826955 +0000 UTC m=+22.870984249" watchObservedRunningTime="2026-06-03 15:03:58.548033221 +0000 UTC m=+22.871190523" Jun 03 15:03:59.203824 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:59.203795 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:03:59.203994 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:03:59.203913 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:03:59.353980 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:59.353946 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7z6vz" event={"ID":"87c43ca0-1f8d-4aba-b1a7-eb96c59e6af5","Type":"ContainerStarted","Data":"5a3f310247415747a5e4037bcb58217a93270de74c6f049c16d9d011fdff74d7"} Jun 03 15:03:59.424582 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:03:59.424555 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 15:04:00.169259 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.169047 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T15:03:59.424578037Z","UUID":"a41750f7-0112-4b61-8332-f79cc1fb1fa6","Handler":null,"Name":"","Endpoint":""} Jun 03 15:04:00.171754 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.171731 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 15:04:00.171754 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.171758 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 15:04:00.204211 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.204186 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:00.204356 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.204186 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:00.204356 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:00.204281 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:00.204484 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:00.204369 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:00.358122 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.358077 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" event={"ID":"3301cb62ffd43ea64420277922b649cc","Type":"ContainerStarted","Data":"83f2af271aab1293dba37ea97b74ec4707c5506ac761cad8b6ac73c29128daa2"} Jun 03 15:04:00.362853 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.362832 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:04:00.363307 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.363279 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"9f38c013cf95762d491541be408741469c0dd2e65803ea89e8260bb6d155da3c"} Jun 03 15:04:00.365429 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.365403 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" event={"ID":"aa8de463-654d-4582-a9c6-76fa1dec361d","Type":"ContainerStarted","Data":"5de696bd20eded87240ea200a23ecf2f578897fb4340e624c6479a0bd0868b0d"} Jun 03 15:04:00.446498 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:00.446307 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7z6vz" podStartSLOduration=5.969856306 podStartE2EDuration="24.446293317s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.509808014 +0000 UTC m=+2.832965295" lastFinishedPulling="2026-06-03 15:03:56.986245023 +0000 UTC m=+21.309402306" observedRunningTime="2026-06-03 15:03:59.458182516 +0000 UTC m=+23.781339829" watchObservedRunningTime="2026-06-03 15:04:00.446293317 +0000 UTC m=+24.769450620" Jun 03 15:04:01.203968 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:01.203931 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:01.204121 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:01.204047 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:01.369251 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:01.369207 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" event={"ID":"aa8de463-654d-4582-a9c6-76fa1dec361d","Type":"ContainerStarted","Data":"14e24d11a766e4bcb11f099b223878058ff3c17f7cf2b53448ff2acbca52ca2d"} Jun 03 15:04:01.414117 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:01.414064 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-0.ec2.internal" podStartSLOduration=24.414048842 podStartE2EDuration="24.414048842s" podCreationTimestamp="2026-06-03 15:03:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:04:00.496135804 +0000 UTC m=+24.819293106" watchObservedRunningTime="2026-06-03 15:04:01.414048842 +0000 UTC m=+25.737206145" Jun 03 15:04:02.204035 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.203994 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:02.204035 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.204033 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:02.204216 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:02.204127 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:02.204490 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:02.204469 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:02.374267 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.374238 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:04:02.374700 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.374655 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"653ec076d058e023c8b8f9d621f7262ea1ac1e1538fee6ca94cee8cd99bffb5d"} Jun 03 15:04:02.375278 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.375163 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:04:02.375278 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.375198 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:04:02.375278 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.375213 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:04:02.375278 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.375263 2574 scope.go:117] "RemoveContainer" containerID="de463f71c7f38bed153c187424cbdea032ec270f367de617a21a1117edbf9c57" Jun 03 15:04:02.393085 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.393059 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:04:02.393233 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.393147 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:04:02.440606 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:02.440541 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j6qsk" podStartSLOduration=4.528055571 podStartE2EDuration="26.44052653s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.515524915 +0000 UTC m=+2.838682196" lastFinishedPulling="2026-06-03 15:04:00.427995873 +0000 UTC m=+24.751153155" observedRunningTime="2026-06-03 15:04:01.413668465 +0000 UTC m=+25.736825767" watchObservedRunningTime="2026-06-03 15:04:02.44052653 +0000 UTC m=+26.763683836" Jun 03 15:04:03.042817 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:03.042784 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:04:03.043298 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:03.043277 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:04:03.203687 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:03.203660 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:03.203848 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:03.203777 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:03.378891 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:03.378861 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:04:03.379624 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:03.379603 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hgmns" Jun 03 15:04:04.203735 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:04.203570 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:04.203901 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:04.203614 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:04.203901 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:04.203823 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:04.203901 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:04.203891 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:04.386071 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:04.386044 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:04:04.386574 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:04.386338 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" event={"ID":"b05f0926-3b3c-4130-9af5-7aac7591cdbd","Type":"ContainerStarted","Data":"7effdc21f183ac6dd5810d2ed5114c250bc54d907829b0fc9a0dba3546f50f30"} Jun 03 15:04:04.387814 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:04.387790 2574 generic.go:358] "Generic (PLEG): container finished" podID="0d75de24-f4bf-4127-b84e-cf5288119dd4" containerID="b8d1b2758e5ef2d58a2f27cec5e612bdbe5a60b53a3ac9fe500a3fbe4427e9f3" exitCode=0 Jun 03 15:04:04.387939 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:04.387869 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" event={"ID":"0d75de24-f4bf-4127-b84e-cf5288119dd4","Type":"ContainerDied","Data":"b8d1b2758e5ef2d58a2f27cec5e612bdbe5a60b53a3ac9fe500a3fbe4427e9f3"} Jun 03 15:04:04.434432 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:04.434381 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" podStartSLOduration=9.893666826 podStartE2EDuration="28.434367474s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.517409638 +0000 UTC m=+2.840566923" lastFinishedPulling="2026-06-03 15:03:57.05811029 +0000 UTC m=+21.381267571" observedRunningTime="2026-06-03 15:04:04.433889797 +0000 UTC m=+28.757047099" watchObservedRunningTime="2026-06-03 15:04:04.434367474 +0000 UTC m=+28.757524776" Jun 03 15:04:05.204226 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:05.204193 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:05.204391 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:05.204317 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:05.391588 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:05.391551 2574 generic.go:358] "Generic (PLEG): container finished" podID="0d75de24-f4bf-4127-b84e-cf5288119dd4" containerID="cbf0ee11dda33b34ac9eae92bf1b374614f7bed618df09c620ccd2a08d93ffa2" exitCode=0 Jun 03 15:04:05.392090 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:05.391608 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" event={"ID":"0d75de24-f4bf-4127-b84e-cf5288119dd4","Type":"ContainerDied","Data":"cbf0ee11dda33b34ac9eae92bf1b374614f7bed618df09c620ccd2a08d93ffa2"} Jun 03 15:04:06.205230 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:06.205187 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:06.205378 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:06.205267 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:06.205378 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:06.205347 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:06.205508 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:06.205484 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:06.395887 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:06.395856 2574 generic.go:358] "Generic (PLEG): container finished" podID="0d75de24-f4bf-4127-b84e-cf5288119dd4" containerID="80b838c6775bae1dfad772673c57b061b0fc9b2d792cae64b960e9cf4acecd0a" exitCode=0 Jun 03 15:04:06.396269 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:06.395902 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" event={"ID":"0d75de24-f4bf-4127-b84e-cf5288119dd4","Type":"ContainerDied","Data":"80b838c6775bae1dfad772673c57b061b0fc9b2d792cae64b960e9cf4acecd0a"} Jun 03 15:04:07.203925 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:07.203894 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:07.204075 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:07.204010 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:08.204520 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:08.204485 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:08.205048 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:08.204615 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:08.205048 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:08.204683 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:08.205048 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:08.204817 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:09.203920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:09.203883 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:09.204212 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:09.204000 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:09.968592 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:09.968554 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:09.968592 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:09.968594 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:09.969093 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:09.968708 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:04:09.969093 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:09.968728 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 15:04:09.969093 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:09.968747 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 15:04:09.969093 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:09.968755 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs podName:2d264119-1673-43ed-817f-de832fc810c9 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:41.968742155 +0000 UTC m=+66.291899435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs") pod "network-metrics-daemon-8gfc9" (UID: "2d264119-1673-43ed-817f-de832fc810c9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 15:04:09.969093 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:09.968759 2574 projected.go:194] Error preparing data for projected volume kube-api-access-gwfw2 for pod openshift-network-diagnostics/network-check-target-sd8kn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:04:09.969093 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:09.968807 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2 podName:9664909d-7a2f-4179-b4cd-87b857dad196 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:41.968795349 +0000 UTC m=+66.291952630 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-gwfw2" (UniqueName: "kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2") pod "network-check-target-sd8kn" (UID: "9664909d-7a2f-4179-b4cd-87b857dad196") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 15:04:10.204232 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:10.204197 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:10.204386 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:10.204205 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:10.204386 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:10.204310 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:10.204494 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:10.204384 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:11.204465 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:11.204410 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:11.204909 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:11.204560 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:12.203867 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:12.203832 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:12.204059 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:12.203869 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:12.204059 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:12.203961 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:12.204177 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:12.204111 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:12.788543 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:12.788501 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:12.789027 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:12.788665 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 15:04:12.789027 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:12.788751 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret podName:2039603c-658b-453a-a073-7870997f32a5 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:44.788730281 +0000 UTC m=+69.111887565 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret") pod "global-pull-secret-syncer-wdhf8" (UID: "2039603c-658b-453a-a073-7870997f32a5") : object "kube-system"/"original-pull-secret" not registered Jun 03 15:04:13.203757 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:13.203716 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:13.203956 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:13.203868 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:14.204701 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:14.204605 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:14.205290 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:14.204747 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:14.205290 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:14.204807 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:14.205290 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:14.204887 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:14.413569 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:14.413534 2574 generic.go:358] "Generic (PLEG): container finished" podID="0d75de24-f4bf-4127-b84e-cf5288119dd4" containerID="17e5ddfb249437a1feae04db3fd00325c4e436400dafb8e5f61790bd15bd5dcc" exitCode=0 Jun 03 15:04:14.413732 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:14.413581 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" event={"ID":"0d75de24-f4bf-4127-b84e-cf5288119dd4","Type":"ContainerDied","Data":"17e5ddfb249437a1feae04db3fd00325c4e436400dafb8e5f61790bd15bd5dcc"} Jun 03 15:04:15.203844 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.203669 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:15.204050 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:15.203925 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:15.244295 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.244262 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gfc9"] Jun 03 15:04:15.244681 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.244393 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:15.244681 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:15.244531 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:15.247788 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.247764 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wdhf8"] Jun 03 15:04:15.252030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.251944 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sd8kn"] Jun 03 15:04:15.252030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.252020 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:15.252140 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:15.252092 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:15.420184 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.420154 2574 generic.go:358] "Generic (PLEG): container finished" podID="0d75de24-f4bf-4127-b84e-cf5288119dd4" containerID="c0019c3a215469b0b290fcb1f8e0cead6e18a06817ac72ceabfb47c27e5f6fef" exitCode=0 Jun 03 15:04:15.420370 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.420215 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" event={"ID":"0d75de24-f4bf-4127-b84e-cf5288119dd4","Type":"ContainerDied","Data":"c0019c3a215469b0b290fcb1f8e0cead6e18a06817ac72ceabfb47c27e5f6fef"} Jun 03 15:04:15.420370 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:15.420232 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:15.420370 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:15.420317 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:16.424372 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:16.424290 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" event={"ID":"0d75de24-f4bf-4127-b84e-cf5288119dd4","Type":"ContainerStarted","Data":"555a1463d0019fcc9edb45de7385e92309725d5ab4b8c0302afda6a67cacd30b"} Jun 03 15:04:16.499676 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:16.499557 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pbgd7" podStartSLOduration=5.601280927 podStartE2EDuration="40.499540542s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:03:38.517719311 +0000 UTC m=+2.840876593" lastFinishedPulling="2026-06-03 15:04:13.415978925 +0000 UTC m=+37.739136208" observedRunningTime="2026-06-03 15:04:16.499324846 +0000 UTC m=+40.822482150" watchObservedRunningTime="2026-06-03 15:04:16.499540542 +0000 UTC m=+40.822697846" Jun 03 15:04:17.203838 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:17.203802 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:17.204023 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:17.203914 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:17.204023 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:17.203920 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:17.204023 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:17.203937 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:17.204023 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:17.204014 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:17.204169 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:17.204091 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:19.204060 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:19.203899 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:19.204494 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:19.203905 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:19.204494 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:19.204133 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sd8kn" podUID="9664909d-7a2f-4179-b4cd-87b857dad196" Jun 03 15:04:19.204494 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:19.203905 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:19.204494 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:19.204214 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8gfc9" podUID="2d264119-1673-43ed-817f-de832fc810c9" Jun 03 15:04:19.204494 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:19.204291 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wdhf8" podUID="2039603c-658b-453a-a073-7870997f32a5" Jun 03 15:04:19.952582 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:19.952554 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-0.ec2.internal" event="NodeReady" Jun 03 15:04:19.952731 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:19.952689 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 03 15:04:20.064150 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.064071 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qnccz"] Jun 03 15:04:20.085224 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.085199 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.094180 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.094158 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d8b8x\"" Jun 03 15:04:20.094356 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.094345 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 15:04:20.094417 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.094399 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 15:04:20.094625 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.094613 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 15:04:20.099474 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.099462 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 15:04:20.105370 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.105353 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s84xw"] Jun 03 15:04:20.120076 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.120053 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qnccz"] Jun 03 15:04:20.120192 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.120181 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s84xw" Jun 03 15:04:20.124429 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.124408 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 15:04:20.125028 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.125010 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 15:04:20.125164 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.125145 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p69ds\"" Jun 03 15:04:20.125470 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.125436 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 15:04:20.148656 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.148628 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s84xw"] Jun 03 15:04:20.154748 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.154722 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6bj54"] Jun 03 15:04:20.180163 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.180138 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.191935 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.191917 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 15:04:20.192440 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.192426 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m5pnr\"" Jun 03 15:04:20.192440 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.192435 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 15:04:20.202478 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.202439 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6bj54"] Jun 03 15:04:20.243467 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.243422 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjfjr\" (UniqueName: \"kubernetes.io/projected/c7aef073-850c-472e-9d51-2dd26e956861-kube-api-access-vjfjr\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.243467 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.243471 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7aef073-850c-472e-9d51-2dd26e956861-data-volume\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.243879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.243539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ac74856-af86-4feb-bf55-93666990a7f9-cert\") pod \"ingress-canary-s84xw\" (UID: \"5ac74856-af86-4feb-bf55-93666990a7f9\") " pod="openshift-ingress-canary/ingress-canary-s84xw" Jun 03 15:04:20.243879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.243623 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7aef073-850c-472e-9d51-2dd26e956861-crio-socket\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.243879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.243660 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7aef073-850c-472e-9d51-2dd26e956861-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.243879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.243679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7aef073-850c-472e-9d51-2dd26e956861-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.243879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.243700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcszf\" (UniqueName: \"kubernetes.io/projected/5ac74856-af86-4feb-bf55-93666990a7f9-kube-api-access-pcszf\") pod \"ingress-canary-s84xw\" (UID: \"5ac74856-af86-4feb-bf55-93666990a7f9\") " pod="openshift-ingress-canary/ingress-canary-s84xw" Jun 03 15:04:20.344534 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344487 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b670147-10da-493d-93c6-eeb1a139faa3-config-volume\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.344722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344558 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vjfjr\" (UniqueName: \"kubernetes.io/projected/c7aef073-850c-472e-9d51-2dd26e956861-kube-api-access-vjfjr\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.344722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344590 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7aef073-850c-472e-9d51-2dd26e956861-data-volume\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.344722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344636 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ac74856-af86-4feb-bf55-93666990a7f9-cert\") pod \"ingress-canary-s84xw\" (UID: \"5ac74856-af86-4feb-bf55-93666990a7f9\") " pod="openshift-ingress-canary/ingress-canary-s84xw" Jun 03 15:04:20.344722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344664 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddtt4\" (UniqueName: \"kubernetes.io/projected/2b670147-10da-493d-93c6-eeb1a139faa3-kube-api-access-ddtt4\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.344926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344722 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7aef073-850c-472e-9d51-2dd26e956861-crio-socket\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.344926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b670147-10da-493d-93c6-eeb1a139faa3-metrics-tls\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.344926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344783 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7aef073-850c-472e-9d51-2dd26e956861-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.344926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344811 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7aef073-850c-472e-9d51-2dd26e956861-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.344926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344837 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcszf\" (UniqueName: \"kubernetes.io/projected/5ac74856-af86-4feb-bf55-93666990a7f9-kube-api-access-pcszf\") pod \"ingress-canary-s84xw\" (UID: \"5ac74856-af86-4feb-bf55-93666990a7f9\") " pod="openshift-ingress-canary/ingress-canary-s84xw" Jun 03 15:04:20.344926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b670147-10da-493d-93c6-eeb1a139faa3-tmp-dir\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.345264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.344945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c7aef073-850c-472e-9d51-2dd26e956861-crio-socket\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.345297 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.345271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c7aef073-850c-472e-9d51-2dd26e956861-data-volume\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.345530 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.345507 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c7aef073-850c-472e-9d51-2dd26e956861-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.348774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.348743 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c7aef073-850c-472e-9d51-2dd26e956861-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.348921 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.348904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ac74856-af86-4feb-bf55-93666990a7f9-cert\") pod \"ingress-canary-s84xw\" (UID: \"5ac74856-af86-4feb-bf55-93666990a7f9\") " pod="openshift-ingress-canary/ingress-canary-s84xw" Jun 03 15:04:20.374885 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.374856 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjfjr\" (UniqueName: \"kubernetes.io/projected/c7aef073-850c-472e-9d51-2dd26e956861-kube-api-access-vjfjr\") pod \"insights-runtime-extractor-qnccz\" (UID: \"c7aef073-850c-472e-9d51-2dd26e956861\") " pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.376512 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.376495 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcszf\" (UniqueName: \"kubernetes.io/projected/5ac74856-af86-4feb-bf55-93666990a7f9-kube-api-access-pcszf\") pod \"ingress-canary-s84xw\" (UID: \"5ac74856-af86-4feb-bf55-93666990a7f9\") " pod="openshift-ingress-canary/ingress-canary-s84xw" Jun 03 15:04:20.394362 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.394334 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qnccz" Jun 03 15:04:20.429276 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.429246 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s84xw" Jun 03 15:04:20.445774 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.445727 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b670147-10da-493d-93c6-eeb1a139faa3-config-volume\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.445903 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.445814 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddtt4\" (UniqueName: \"kubernetes.io/projected/2b670147-10da-493d-93c6-eeb1a139faa3-kube-api-access-ddtt4\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.445903 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.445871 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b670147-10da-493d-93c6-eeb1a139faa3-metrics-tls\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.445903 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.445900 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b670147-10da-493d-93c6-eeb1a139faa3-tmp-dir\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.446668 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.446639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2b670147-10da-493d-93c6-eeb1a139faa3-config-volume\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.448532 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.448512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2b670147-10da-493d-93c6-eeb1a139faa3-metrics-tls\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.455717 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.455695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b670147-10da-493d-93c6-eeb1a139faa3-tmp-dir\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.480688 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.480624 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddtt4\" (UniqueName: \"kubernetes.io/projected/2b670147-10da-493d-93c6-eeb1a139faa3-kube-api-access-ddtt4\") pod \"dns-default-6bj54\" (UID: \"2b670147-10da-493d-93c6-eeb1a139faa3\") " pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.488349 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.488300 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:20.602954 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.602879 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s84xw"] Jun 03 15:04:20.606334 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:20.606296 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac74856_af86_4feb_bf55_93666990a7f9.slice/crio-50cabebe7d29a63b1b7cd14241c17829d2de88dfc8efe8e8da949622d3f2b88c WatchSource:0}: Error finding container 50cabebe7d29a63b1b7cd14241c17829d2de88dfc8efe8e8da949622d3f2b88c: Status 404 returned error can't find the container with id 50cabebe7d29a63b1b7cd14241c17829d2de88dfc8efe8e8da949622d3f2b88c Jun 03 15:04:20.609728 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.609704 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qnccz"] Jun 03 15:04:20.611820 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:20.611796 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7aef073_850c_472e_9d51_2dd26e956861.slice/crio-d57d8429ded86040c7fc797619bf5406bc105bceb170152d7ceadf17e2ba84af WatchSource:0}: Error finding container d57d8429ded86040c7fc797619bf5406bc105bceb170152d7ceadf17e2ba84af: Status 404 returned error can't find the container with id d57d8429ded86040c7fc797619bf5406bc105bceb170152d7ceadf17e2ba84af Jun 03 15:04:20.645568 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:20.645531 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6bj54"] Jun 03 15:04:20.648966 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:20.648937 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b670147_10da_493d_93c6_eeb1a139faa3.slice/crio-650d7e55972210e76b78e08302478f22130884ddacce85111423e0733ac7349c WatchSource:0}: Error finding container 650d7e55972210e76b78e08302478f22130884ddacce85111423e0733ac7349c: Status 404 returned error can't find the container with id 650d7e55972210e76b78e08302478f22130884ddacce85111423e0733ac7349c Jun 03 15:04:21.204258 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.204019 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:21.204501 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.204104 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:21.204750 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.204122 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:21.208198 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.208181 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:04:21.210354 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.210332 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:04:21.212171 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.212089 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:04:21.212495 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.212475 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkmcm\"" Jun 03 15:04:21.212694 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.212682 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cj8w\"" Jun 03 15:04:21.212847 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.212836 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:04:21.435004 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.434963 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6bj54" event={"ID":"2b670147-10da-493d-93c6-eeb1a139faa3","Type":"ContainerStarted","Data":"650d7e55972210e76b78e08302478f22130884ddacce85111423e0733ac7349c"} Jun 03 15:04:21.436236 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.436194 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s84xw" event={"ID":"5ac74856-af86-4feb-bf55-93666990a7f9","Type":"ContainerStarted","Data":"50cabebe7d29a63b1b7cd14241c17829d2de88dfc8efe8e8da949622d3f2b88c"} Jun 03 15:04:21.437829 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.437801 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnccz" event={"ID":"c7aef073-850c-472e-9d51-2dd26e956861","Type":"ContainerStarted","Data":"20fab79fed0ec6d1db8a6ddb5aed0e2e4050d964ecfbdd363c15a0f68c809cdd"} Jun 03 15:04:21.437829 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:21.437830 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnccz" event={"ID":"c7aef073-850c-472e-9d51-2dd26e956861","Type":"ContainerStarted","Data":"d57d8429ded86040c7fc797619bf5406bc105bceb170152d7ceadf17e2ba84af"} Jun 03 15:04:23.443295 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.443263 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6bj54" event={"ID":"2b670147-10da-493d-93c6-eeb1a139faa3","Type":"ContainerStarted","Data":"39d1e5bc05e4c28b358fe2d98204add5edb4b6b7e2436bb50ec54227c95d27b3"} Jun 03 15:04:23.444614 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.444585 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s84xw" event={"ID":"5ac74856-af86-4feb-bf55-93666990a7f9","Type":"ContainerStarted","Data":"2cb0c4bfd3d52a8f13568d9c0da1d862c50dc9d0de1945b31455d665c5e34115"} Jun 03 15:04:23.476192 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.476134 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s84xw" podStartSLOduration=0.810147248 podStartE2EDuration="3.476120605s" podCreationTimestamp="2026-06-03 15:04:20 +0000 UTC" firstStartedPulling="2026-06-03 15:04:20.608374409 +0000 UTC m=+44.931531690" lastFinishedPulling="2026-06-03 15:04:23.274347748 +0000 UTC m=+47.597505047" observedRunningTime="2026-06-03 15:04:23.475372071 +0000 UTC m=+47.798529354" watchObservedRunningTime="2026-06-03 15:04:23.476120605 +0000 UTC m=+47.799277907" Jun 03 15:04:23.941328 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.941258 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bqnf6"] Jun 03 15:04:23.967014 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.966982 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bqnf6"] Jun 03 15:04:23.967158 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.967063 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:23.970520 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.970499 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8rh47\"" Jun 03 15:04:23.970703 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.970500 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 15:04:23.970793 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.970777 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 15:04:23.970864 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.970777 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:04:23.971016 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.971002 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 15:04:23.974888 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.972191 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 15:04:23.987499 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.987478 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:23.987614 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.987525 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:23.987614 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.987547 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx4zg\" (UniqueName: \"kubernetes.io/projected/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-kube-api-access-lx4zg\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:23.987719 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:23.987643 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.023852 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.023819 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-smdgj"] Jun 03 15:04:24.042089 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.042062 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.044982 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.044948 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 03 15:04:24.045111 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.045024 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 03 15:04:24.045111 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.045090 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8gdvx\"" Jun 03 15:04:24.045559 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.045542 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 03 15:04:24.058468 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.058422 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-smdgj"] Jun 03 15:04:24.076880 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.076845 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vhmzs"] Jun 03 15:04:24.088028 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.087998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.088161 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088030 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.088161 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088056 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.088161 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088099 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82bf64c8-a17d-40e1-9409-a44e6d736eb6-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.088161 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088151 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.088340 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088173 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lx4zg\" (UniqueName: \"kubernetes.io/projected/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-kube-api-access-lx4zg\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.088340 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088190 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/82bf64c8-a17d-40e1-9409-a44e6d736eb6-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.088340 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.088340 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088235 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.088340 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gh27\" (UniqueName: \"kubernetes.io/projected/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-api-access-6gh27\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.088340 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:24.088296 2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 15:04:24.088575 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:24.088372 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-tls podName:81b9b4b9-f68b-4f13-a456-9d911e1ee25a nodeName:}" failed. No retries permitted until 2026-06-03 15:04:24.588353814 +0000 UTC m=+48.911511095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-bqnf6" (UID: "81b9b4b9-f68b-4f13-a456-9d911e1ee25a") : secret "openshift-state-metrics-tls" not found Jun 03 15:04:24.088699 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.088678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.092618 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.092599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.099440 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.099421 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.110624 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.110608 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 15:04:24.110720 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.110664 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 15:04:24.112845 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.112829 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x69pg\"" Jun 03 15:04:24.112925 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.112858 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 15:04:24.136423 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.136399 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx4zg\" (UniqueName: \"kubernetes.io/projected/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-kube-api-access-lx4zg\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.189211 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-root\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189380 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189215 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189380 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189245 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6gh27\" (UniqueName: \"kubernetes.io/projected/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-api-access-6gh27\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.189380 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc6e069e-2819-404a-a2b9-299cc9209a27-metrics-client-ca\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189380 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-sys\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189380 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-textfile\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189623 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdgsb\" (UniqueName: \"kubernetes.io/projected/bc6e069e-2819-404a-a2b9-299cc9209a27-kube-api-access-vdgsb\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189623 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189519 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.189623 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189555 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.189623 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189802 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:24.189626 2574 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 03 15:04:24.189802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189649 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.189802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-wtmp\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189802 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:24.189693 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-tls podName:82bf64c8-a17d-40e1-9409-a44e6d736eb6 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:24.689672967 +0000 UTC m=+49.012830250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-tls") pod "kube-state-metrics-8469c486bb-smdgj" (UID: "82bf64c8-a17d-40e1-9409-a44e6d736eb6") : secret "kube-state-metrics-tls" not found Jun 03 15:04:24.189802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189730 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82bf64c8-a17d-40e1-9409-a44e6d736eb6-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.189802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.189802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.189787 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/82bf64c8-a17d-40e1-9409-a44e6d736eb6-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.190155 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.190139 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/82bf64c8-a17d-40e1-9409-a44e6d736eb6-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.190396 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.190380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82bf64c8-a17d-40e1-9409-a44e6d736eb6-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.190679 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.190656 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.192131 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.192083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.210376 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.210353 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gh27\" (UniqueName: \"kubernetes.io/projected/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-api-access-6gh27\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.290110 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290080 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc6e069e-2819-404a-a2b9-299cc9209a27-metrics-client-ca\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290110 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290113 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-sys\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290347 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290139 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-textfile\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290347 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290158 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vdgsb\" (UniqueName: \"kubernetes.io/projected/bc6e069e-2819-404a-a2b9-299cc9209a27-kube-api-access-vdgsb\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290347 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290211 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-sys\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290347 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290320 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290579 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290399 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-wtmp\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290579 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290439 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290579 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290506 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-textfile\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290579 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290514 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-root\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290579 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290543 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290855 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290581 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-wtmp\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290855 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290594 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc6e069e-2819-404a-a2b9-299cc9209a27-root\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290855 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:24.290602 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 15:04:24.290855 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:24.290650 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls podName:bc6e069e-2819-404a-a2b9-299cc9209a27 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:24.79063618 +0000 UTC m=+49.113793461 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls") pod "node-exporter-vhmzs" (UID: "bc6e069e-2819-404a-a2b9-299cc9209a27") : secret "node-exporter-tls" not found Jun 03 15:04:24.290855 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc6e069e-2819-404a-a2b9-299cc9209a27-metrics-client-ca\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.290855 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.290821 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-accelerators-collector-config\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.292907 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.292888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.310374 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.310337 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdgsb\" (UniqueName: \"kubernetes.io/projected/bc6e069e-2819-404a-a2b9-299cc9209a27-kube-api-access-vdgsb\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.449160 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.449075 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnccz" event={"ID":"c7aef073-850c-472e-9d51-2dd26e956861","Type":"ContainerStarted","Data":"c72f940c5ff85c9041e5514e2cb8a4a579a0526d10483a8caf442d366e41d403"} Jun 03 15:04:24.450480 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.450434 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6bj54" event={"ID":"2b670147-10da-493d-93c6-eeb1a139faa3","Type":"ContainerStarted","Data":"1d95b2fba09a437c1393abd836feadd07ad11433834fa18cfa7640a559a816ed"} Jun 03 15:04:24.450784 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.450761 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:24.487734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.487678 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6bj54" podStartSLOduration=1.864693801 podStartE2EDuration="4.487662633s" podCreationTimestamp="2026-06-03 15:04:20 +0000 UTC" firstStartedPulling="2026-06-03 15:04:20.651381062 +0000 UTC m=+44.974538343" lastFinishedPulling="2026-06-03 15:04:23.274349695 +0000 UTC m=+47.597507175" observedRunningTime="2026-06-03 15:04:24.487527641 +0000 UTC m=+48.810684956" watchObservedRunningTime="2026-06-03 15:04:24.487662633 +0000 UTC m=+48.810819937" Jun 03 15:04:24.593117 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.593082 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.595905 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.595867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/81b9b4b9-f68b-4f13-a456-9d911e1ee25a-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-bqnf6\" (UID: \"81b9b4b9-f68b-4f13-a456-9d911e1ee25a\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.694249 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.694215 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.696698 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.696676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82bf64c8-a17d-40e1-9409-a44e6d736eb6-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-smdgj\" (UID: \"82bf64c8-a17d-40e1-9409-a44e6d736eb6\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:24.794788 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.794710 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:24.794930 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:24.794833 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 03 15:04:24.794930 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:04:24.794899 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls podName:bc6e069e-2819-404a-a2b9-299cc9209a27 nodeName:}" failed. No retries permitted until 2026-06-03 15:04:25.79488356 +0000 UTC m=+50.118040845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls") pod "node-exporter-vhmzs" (UID: "bc6e069e-2819-404a-a2b9-299cc9209a27") : secret "node-exporter-tls" not found Jun 03 15:04:24.878127 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.878096 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" Jun 03 15:04:24.950874 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:24.950846 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" Jun 03 15:04:25.035373 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:25.032687 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b9b4b9_f68b_4f13_a456_9d911e1ee25a.slice/crio-dff004c263953cce02c7492d213c9233e8894d77aba3cd1a02c58b249ea78321 WatchSource:0}: Error finding container dff004c263953cce02c7492d213c9233e8894d77aba3cd1a02c58b249ea78321: Status 404 returned error can't find the container with id dff004c263953cce02c7492d213c9233e8894d77aba3cd1a02c58b249ea78321 Jun 03 15:04:25.036248 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.036206 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-bqnf6"] Jun 03 15:04:25.083370 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.083339 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-smdgj"] Jun 03 15:04:25.086293 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:25.086268 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82bf64c8_a17d_40e1_9409_a44e6d736eb6.slice/crio-9757c850ac9e07c6f41598640bf17ef7fd773658f613aa557d3c3dbf52169c57 WatchSource:0}: Error finding container 9757c850ac9e07c6f41598640bf17ef7fd773658f613aa557d3c3dbf52169c57: Status 404 returned error can't find the container with id 9757c850ac9e07c6f41598640bf17ef7fd773658f613aa557d3c3dbf52169c57 Jun 03 15:04:25.455156 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.454952 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" event={"ID":"82bf64c8-a17d-40e1-9409-a44e6d736eb6","Type":"ContainerStarted","Data":"9757c850ac9e07c6f41598640bf17ef7fd773658f613aa557d3c3dbf52169c57"} Jun 03 15:04:25.457321 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.457294 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" event={"ID":"81b9b4b9-f68b-4f13-a456-9d911e1ee25a","Type":"ContainerStarted","Data":"a4b77346f5998e3e0528d4d51b8acea17fff0470858602af5d336be6fec0c17f"} Jun 03 15:04:25.457475 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.457325 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" event={"ID":"81b9b4b9-f68b-4f13-a456-9d911e1ee25a","Type":"ContainerStarted","Data":"f230fbb7333e2e596987ae83e46c63d58c6c848c1b0239a81da05f80c57d2359"} Jun 03 15:04:25.457475 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.457336 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" event={"ID":"81b9b4b9-f68b-4f13-a456-9d911e1ee25a","Type":"ContainerStarted","Data":"dff004c263953cce02c7492d213c9233e8894d77aba3cd1a02c58b249ea78321"} Jun 03 15:04:25.802942 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.802854 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:25.806057 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.806028 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc6e069e-2819-404a-a2b9-299cc9209a27-node-exporter-tls\") pod \"node-exporter-vhmzs\" (UID: \"bc6e069e-2819-404a-a2b9-299cc9209a27\") " pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:25.907380 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:25.907342 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vhmzs" Jun 03 15:04:26.419789 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:26.419755 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6e069e_2819_404a_a2b9_299cc9209a27.slice/crio-66811180169a47413b8a1bdea008761282714350ad81808cb7ae788731d5f7a3 WatchSource:0}: Error finding container 66811180169a47413b8a1bdea008761282714350ad81808cb7ae788731d5f7a3: Status 404 returned error can't find the container with id 66811180169a47413b8a1bdea008761282714350ad81808cb7ae788731d5f7a3 Jun 03 15:04:26.464479 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:26.464424 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhmzs" event={"ID":"bc6e069e-2819-404a-a2b9-299cc9209a27","Type":"ContainerStarted","Data":"66811180169a47413b8a1bdea008761282714350ad81808cb7ae788731d5f7a3"} Jun 03 15:04:27.469033 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:27.468986 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qnccz" event={"ID":"c7aef073-850c-472e-9d51-2dd26e956861","Type":"ContainerStarted","Data":"dfd0d88f89421f315f253e7a77e8e5c282a53dc35f80ecdd466411d5f7855b32"} Jun 03 15:04:27.492145 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:27.492096 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qnccz" podStartSLOduration=1.4669278860000001 podStartE2EDuration="7.492083892s" podCreationTimestamp="2026-06-03 15:04:20 +0000 UTC" firstStartedPulling="2026-06-03 15:04:20.746511817 +0000 UTC m=+45.069669099" lastFinishedPulling="2026-06-03 15:04:26.771667825 +0000 UTC m=+51.094825105" observedRunningTime="2026-06-03 15:04:27.491288095 +0000 UTC m=+51.814445400" watchObservedRunningTime="2026-06-03 15:04:27.492083892 +0000 UTC m=+51.815241189" Jun 03 15:04:28.472551 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.472509 2574 generic.go:358] "Generic (PLEG): container finished" podID="bc6e069e-2819-404a-a2b9-299cc9209a27" containerID="58fd96f2a7d9af55c7feaa040a20a7c6dcb362607fa8237f370cc5c3876852d0" exitCode=0 Jun 03 15:04:28.472945 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.472590 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhmzs" event={"ID":"bc6e069e-2819-404a-a2b9-299cc9209a27","Type":"ContainerDied","Data":"58fd96f2a7d9af55c7feaa040a20a7c6dcb362607fa8237f370cc5c3876852d0"} Jun 03 15:04:28.474478 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.474430 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" event={"ID":"81b9b4b9-f68b-4f13-a456-9d911e1ee25a","Type":"ContainerStarted","Data":"22f81afdcba1868a920cb2991e865cb315289b8b0ad1884b169a7a06438efc8d"} Jun 03 15:04:28.562111 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.562066 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-bqnf6" podStartSLOduration=2.704822586 podStartE2EDuration="5.562053952s" podCreationTimestamp="2026-06-03 15:04:23 +0000 UTC" firstStartedPulling="2026-06-03 15:04:25.235950194 +0000 UTC m=+49.559107475" lastFinishedPulling="2026-06-03 15:04:28.093181544 +0000 UTC m=+52.416338841" observedRunningTime="2026-06-03 15:04:28.561741993 +0000 UTC m=+52.884899297" watchObservedRunningTime="2026-06-03 15:04:28.562053952 +0000 UTC m=+52.885211233" Jun 03 15:04:28.747097 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.747062 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4"] Jun 03 15:04:28.753352 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.753337 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" Jun 03 15:04:28.758483 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.758462 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-5j479\"" Jun 03 15:04:28.758659 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.758640 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 03 15:04:28.768736 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.768710 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4"] Jun 03 15:04:28.826593 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.826560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/248dd05d-fba4-4629-ba1e-0bf8f49d0324-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-fs8k4\" (UID: \"248dd05d-fba4-4629-ba1e-0bf8f49d0324\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" Jun 03 15:04:28.927956 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.927867 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/248dd05d-fba4-4629-ba1e-0bf8f49d0324-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-fs8k4\" (UID: \"248dd05d-fba4-4629-ba1e-0bf8f49d0324\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" Jun 03 15:04:28.931535 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:28.931516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/248dd05d-fba4-4629-ba1e-0bf8f49d0324-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-fs8k4\" (UID: \"248dd05d-fba4-4629-ba1e-0bf8f49d0324\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" Jun 03 15:04:29.062252 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:29.062219 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" Jun 03 15:04:29.195049 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:29.194856 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4"] Jun 03 15:04:29.198487 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:29.198432 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248dd05d_fba4_4629_ba1e_0bf8f49d0324.slice/crio-63e5f75c21cebf74ff258755ea1f1ab5d5e2a350d3f58a321147ebe98fb4d25a WatchSource:0}: Error finding container 63e5f75c21cebf74ff258755ea1f1ab5d5e2a350d3f58a321147ebe98fb4d25a: Status 404 returned error can't find the container with id 63e5f75c21cebf74ff258755ea1f1ab5d5e2a350d3f58a321147ebe98fb4d25a Jun 03 15:04:29.478768 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:29.478689 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhmzs" event={"ID":"bc6e069e-2819-404a-a2b9-299cc9209a27","Type":"ContainerStarted","Data":"462cdf2a811603f0696e5482bcc8818c4cf449ee9c7a5c4e98d190b0275c3a48"} Jun 03 15:04:29.478768 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:29.478729 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vhmzs" event={"ID":"bc6e069e-2819-404a-a2b9-299cc9209a27","Type":"ContainerStarted","Data":"87a851b72f522b8402c65f344e90ef1d8707b6ed17b2b4e9cf95648cc0beb462"} Jun 03 15:04:29.479894 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:29.479874 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" event={"ID":"248dd05d-fba4-4629-ba1e-0bf8f49d0324","Type":"ContainerStarted","Data":"63e5f75c21cebf74ff258755ea1f1ab5d5e2a350d3f58a321147ebe98fb4d25a"} Jun 03 15:04:29.503455 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:29.503399 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vhmzs" podStartSLOduration=4.829810449 podStartE2EDuration="6.503381742s" podCreationTimestamp="2026-06-03 15:04:23 +0000 UTC" firstStartedPulling="2026-06-03 15:04:26.421684343 +0000 UTC m=+50.744841631" lastFinishedPulling="2026-06-03 15:04:28.095255621 +0000 UTC m=+52.418412924" observedRunningTime="2026-06-03 15:04:29.502522641 +0000 UTC m=+53.825679934" watchObservedRunningTime="2026-06-03 15:04:29.503381742 +0000 UTC m=+53.826539046" Jun 03 15:04:30.274373 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.274202 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:04:30.289554 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.289523 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.293927 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.293417 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:04:30.294870 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.294702 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 15:04:30.294870 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.294748 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 15:04:30.295259 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.295241 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 15:04:30.295391 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.295315 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 15:04:30.295501 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.295472 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 15:04:30.295639 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.295624 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wdmmx\"" Jun 03 15:04:30.296691 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.296409 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 15:04:30.296691 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.296413 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-359t9en0l9e0t\"" Jun 03 15:04:30.296806 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.296748 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 15:04:30.296806 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.296759 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 15:04:30.296936 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.296915 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 15:04:30.297190 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.297172 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 15:04:30.298234 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.298214 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 15:04:30.301488 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.301377 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 15:04:30.303657 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.303635 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 15:04:30.338903 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.338875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-config-out\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339069 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.338915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339069 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.338950 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339069 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339216 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339216 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339096 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-config\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339216 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339121 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339216 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339348 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frzxt\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-kube-api-access-frzxt\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339348 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339298 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339348 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339336 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339488 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339488 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339488 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-web-config\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339488 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339488 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339699 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339505 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.339699 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.339549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440353 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440323 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440552 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440370 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440552 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440401 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-config-out\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440552 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440419 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440552 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440439 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440552 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440478 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440552 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440500 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440552 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440527 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-config\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440552 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440550 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440583 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440637 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-frzxt\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-kube-api-access-frzxt\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440660 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440681 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440705 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440734 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440765 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-web-config\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440791 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.440920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440817 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.441292 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.440946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.443242 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.441917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.443242 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.442901 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.444590 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.444564 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.444784 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.444766 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-config-out\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.445251 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.445233 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-web-config\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.445393 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.445377 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.445513 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.445375 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.445680 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.445625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.445815 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.445759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.445873 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.445816 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.446699 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.446676 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.446895 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.446879 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.446973 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.446904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.447045 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.447033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.447722 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.447704 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.447848 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.447832 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-config\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.454920 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.454897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frzxt\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-kube-api-access-frzxt\") pod \"prometheus-k8s-0\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.604161 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.604124 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:30.749598 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:30.749568 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:04:31.160350 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:31.160311 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41d60c17_e90f_47a7_b730_cdcacdbd51df.slice/crio-2a4974d5a491aaffe9f576b561c0d90b80aaa394b68788060babcb26f201f10c WatchSource:0}: Error finding container 2a4974d5a491aaffe9f576b561c0d90b80aaa394b68788060babcb26f201f10c: Status 404 returned error can't find the container with id 2a4974d5a491aaffe9f576b561c0d90b80aaa394b68788060babcb26f201f10c Jun 03 15:04:31.485938 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:31.485866 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerStarted","Data":"2a4974d5a491aaffe9f576b561c0d90b80aaa394b68788060babcb26f201f10c"} Jun 03 15:04:32.490634 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:32.490604 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" event={"ID":"248dd05d-fba4-4629-ba1e-0bf8f49d0324","Type":"ContainerStarted","Data":"43bfaee3dbdb46122904d3290c834e10a652549d4ec68842f7d71ab739c95afe"} Jun 03 15:04:32.490995 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:32.490979 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" Jun 03 15:04:32.492379 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:32.492353 2574 generic.go:358] "Generic (PLEG): container finished" podID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" exitCode=0 Jun 03 15:04:32.492522 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:32.492409 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerDied","Data":"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f"} Jun 03 15:04:32.495725 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:32.495703 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" Jun 03 15:04:32.523974 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:32.523930 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-fs8k4" podStartSLOduration=2.223576467 podStartE2EDuration="4.523916781s" podCreationTimestamp="2026-06-03 15:04:28 +0000 UTC" firstStartedPulling="2026-06-03 15:04:29.200160388 +0000 UTC m=+53.523317670" lastFinishedPulling="2026-06-03 15:04:31.500500702 +0000 UTC m=+55.823657984" observedRunningTime="2026-06-03 15:04:32.523816134 +0000 UTC m=+56.846973440" watchObservedRunningTime="2026-06-03 15:04:32.523916781 +0000 UTC m=+56.847074062" Jun 03 15:04:34.460367 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:34.460337 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6bj54" Jun 03 15:04:35.405158 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:35.405119 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7h852" Jun 03 15:04:37.507869 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:37.507833 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerStarted","Data":"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d"} Jun 03 15:04:37.507869 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:37.507871 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerStarted","Data":"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c"} Jun 03 15:04:38.512710 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:38.512677 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" event={"ID":"82bf64c8-a17d-40e1-9409-a44e6d736eb6","Type":"ContainerStarted","Data":"e3027bcf29c0dd8f854f9ce318324288f5d49d0f4ea9cc244f8dcf06b0b18d98"} Jun 03 15:04:38.513060 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:38.512721 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" event={"ID":"82bf64c8-a17d-40e1-9409-a44e6d736eb6","Type":"ContainerStarted","Data":"cc1edec2b26ab6d950c5e2088249ddc553860e937a6ee54a0b5ce812e6b2c7a5"} Jun 03 15:04:39.517237 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:39.517145 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" event={"ID":"82bf64c8-a17d-40e1-9409-a44e6d736eb6","Type":"ContainerStarted","Data":"9e52ce06a26749b4f65e933e09e9784bfc0882322f322abc1afeff76d85c635d"} Jun 03 15:04:39.520006 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:39.519980 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerStarted","Data":"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce"} Jun 03 15:04:39.520131 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:39.520013 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerStarted","Data":"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb"} Jun 03 15:04:39.520131 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:39.520022 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerStarted","Data":"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b"} Jun 03 15:04:39.520131 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:39.520030 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerStarted","Data":"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6"} Jun 03 15:04:39.589947 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:39.589899 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-smdgj" podStartSLOduration=3.369938286 podStartE2EDuration="16.589885068s" podCreationTimestamp="2026-06-03 15:04:23 +0000 UTC" firstStartedPulling="2026-06-03 15:04:25.088918042 +0000 UTC m=+49.412075322" lastFinishedPulling="2026-06-03 15:04:38.308864808 +0000 UTC m=+62.632022104" observedRunningTime="2026-06-03 15:04:39.545591847 +0000 UTC m=+63.868749150" watchObservedRunningTime="2026-06-03 15:04:39.589885068 +0000 UTC m=+63.913042371" Jun 03 15:04:39.590203 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:39.590183 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.612286822 podStartE2EDuration="9.590177374s" podCreationTimestamp="2026-06-03 15:04:30 +0000 UTC" firstStartedPulling="2026-06-03 15:04:31.166119711 +0000 UTC m=+55.489276991" lastFinishedPulling="2026-06-03 15:04:39.144010262 +0000 UTC m=+63.467167543" observedRunningTime="2026-06-03 15:04:39.586929343 +0000 UTC m=+63.910086670" watchObservedRunningTime="2026-06-03 15:04:39.590177374 +0000 UTC m=+63.913334677" Jun 03 15:04:40.605074 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:40.605032 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:04:42.048229 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.048172 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:42.048229 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.048234 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:42.051559 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.051538 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 15:04:42.051726 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.051708 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 15:04:42.061537 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.061512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d264119-1673-43ed-817f-de832fc810c9-metrics-certs\") pod \"network-metrics-daemon-8gfc9\" (UID: \"2d264119-1673-43ed-817f-de832fc810c9\") " pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:42.061950 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.061934 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 15:04:42.071786 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.071764 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwfw2\" (UniqueName: \"kubernetes.io/projected/9664909d-7a2f-4179-b4cd-87b857dad196-kube-api-access-gwfw2\") pod \"network-check-target-sd8kn\" (UID: \"9664909d-7a2f-4179-b4cd-87b857dad196\") " pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:42.220872 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.220841 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zkmcm\"" Jun 03 15:04:42.228494 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.228472 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:42.237381 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.237357 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6cj8w\"" Jun 03 15:04:42.244227 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.244201 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8gfc9" Jun 03 15:04:42.380493 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.380381 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sd8kn"] Jun 03 15:04:42.385784 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:42.385749 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9664909d_7a2f_4179_b4cd_87b857dad196.slice/crio-be152ea21d18c834d9c454dcc929b00040a8b320d279e0152c8bd9268aae7dcd WatchSource:0}: Error finding container be152ea21d18c834d9c454dcc929b00040a8b320d279e0152c8bd9268aae7dcd: Status 404 returned error can't find the container with id be152ea21d18c834d9c454dcc929b00040a8b320d279e0152c8bd9268aae7dcd Jun 03 15:04:42.403490 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.403439 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8gfc9"] Jun 03 15:04:42.408148 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:04:42.408120 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d264119_1673_43ed_817f_de832fc810c9.slice/crio-19fa4f01cedfd138bb5a66192bbdac6d5c1282d3d264aa82206fc458ca3473c8 WatchSource:0}: Error finding container 19fa4f01cedfd138bb5a66192bbdac6d5c1282d3d264aa82206fc458ca3473c8: Status 404 returned error can't find the container with id 19fa4f01cedfd138bb5a66192bbdac6d5c1282d3d264aa82206fc458ca3473c8 Jun 03 15:04:42.531991 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.531947 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gfc9" event={"ID":"2d264119-1673-43ed-817f-de832fc810c9","Type":"ContainerStarted","Data":"19fa4f01cedfd138bb5a66192bbdac6d5c1282d3d264aa82206fc458ca3473c8"} Jun 03 15:04:42.533748 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:42.533715 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sd8kn" event={"ID":"9664909d-7a2f-4179-b4cd-87b857dad196","Type":"ContainerStarted","Data":"be152ea21d18c834d9c454dcc929b00040a8b320d279e0152c8bd9268aae7dcd"} Jun 03 15:04:44.875130 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:44.875084 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:44.878617 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:44.878595 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 15:04:44.888174 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:44.888135 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2039603c-658b-453a-a073-7870997f32a5-original-pull-secret\") pod \"global-pull-secret-syncer-wdhf8\" (UID: \"2039603c-658b-453a-a073-7870997f32a5\") " pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:44.927256 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:44.927223 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wdhf8" Jun 03 15:04:45.105557 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:45.105472 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wdhf8"] Jun 03 15:04:45.546551 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:45.546472 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wdhf8" event={"ID":"2039603c-658b-453a-a073-7870997f32a5","Type":"ContainerStarted","Data":"f7f3feb631064d3a5d490ad0ed16caa8d1e4f9978c9e196617b7c0c40b313cde"} Jun 03 15:04:45.548185 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:45.548149 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gfc9" event={"ID":"2d264119-1673-43ed-817f-de832fc810c9","Type":"ContainerStarted","Data":"c78bc531fa08d9c5534fd4206a902f749dd4463363a8b78f891de47f7ad9565d"} Jun 03 15:04:45.548185 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:45.548195 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8gfc9" event={"ID":"2d264119-1673-43ed-817f-de832fc810c9","Type":"ContainerStarted","Data":"27fa6822f0603cd96bee2e2e5238253bdc6751d7d5c8b4892123bd25747a6551"} Jun 03 15:04:45.579380 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:45.579305 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8gfc9" podStartSLOduration=67.425505661 podStartE2EDuration="1m9.579282893s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:04:42.410810526 +0000 UTC m=+66.733967807" lastFinishedPulling="2026-06-03 15:04:44.56458774 +0000 UTC m=+68.887745039" observedRunningTime="2026-06-03 15:04:45.577532324 +0000 UTC m=+69.900689631" watchObservedRunningTime="2026-06-03 15:04:45.579282893 +0000 UTC m=+69.902440196" Jun 03 15:04:47.555960 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:47.555905 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sd8kn" event={"ID":"9664909d-7a2f-4179-b4cd-87b857dad196","Type":"ContainerStarted","Data":"24b879b886f48cadab787ff9994c5b7db60c7be0a93df911360700dce7434eeb"} Jun 03 15:04:47.556434 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:47.556078 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:04:50.566864 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:50.566827 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wdhf8" event={"ID":"2039603c-658b-453a-a073-7870997f32a5","Type":"ContainerStarted","Data":"bd69c54d83eb488794b1f51b45cf061815aa2fdd6d76386b402fb873f2387926"} Jun 03 15:04:50.587434 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:04:50.587383 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sd8kn" podStartSLOduration=70.357072247 podStartE2EDuration="1m14.587368381s" podCreationTimestamp="2026-06-03 15:03:36 +0000 UTC" firstStartedPulling="2026-06-03 15:04:42.38793998 +0000 UTC m=+66.711097260" lastFinishedPulling="2026-06-03 15:04:46.618236097 +0000 UTC m=+70.941393394" observedRunningTime="2026-06-03 15:04:47.585804962 +0000 UTC m=+71.908962265" watchObservedRunningTime="2026-06-03 15:04:50.587368381 +0000 UTC m=+74.910525683" Jun 03 15:05:18.562321 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:18.562290 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sd8kn" Jun 03 15:05:18.579878 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:18.579829 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wdhf8" podStartSLOduration=93.920321828 podStartE2EDuration="1m38.579812757s" podCreationTimestamp="2026-06-03 15:03:40 +0000 UTC" firstStartedPulling="2026-06-03 15:04:45.113363318 +0000 UTC m=+69.436520605" lastFinishedPulling="2026-06-03 15:04:49.772854243 +0000 UTC m=+74.096011534" observedRunningTime="2026-06-03 15:04:50.586912268 +0000 UTC m=+74.910069571" watchObservedRunningTime="2026-06-03 15:05:18.579812757 +0000 UTC m=+102.902970059" Jun 03 15:05:39.324726 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:39.324688 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:39.344082 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:39.344056 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:39.713687 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:39.713615 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:48.776793 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:48.776754 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:05:48.777418 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:48.777278 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="prometheus" containerID="cri-o://d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" gracePeriod=600 Jun 03 15:05:48.777418 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:48.777311 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy" containerID="cri-o://52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" gracePeriod=600 Jun 03 15:05:48.777418 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:48.777335 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy-thanos" containerID="cri-o://73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" gracePeriod=600 Jun 03 15:05:48.777690 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:48.777334 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="config-reloader" containerID="cri-o://0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" gracePeriod=600 Jun 03 15:05:48.777690 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:48.777347 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy-web" containerID="cri-o://41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" gracePeriod=600 Jun 03 15:05:48.777690 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:48.777290 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="thanos-sidecar" containerID="cri-o://403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" gracePeriod=600 Jun 03 15:05:49.012521 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.012496 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.056045 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.055962 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-tls-assets\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056045 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056016 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-tls\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056045 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056033 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-rulefiles-0\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056305 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056051 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frzxt\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-kube-api-access-frzxt\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056305 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056192 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-serving-certs-ca-bundle\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056305 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056232 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056305 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056273 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-kubelet-serving-ca-bundle\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056305 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056301 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-metrics-client-certs\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056584 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056326 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-grpc-tls\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.056584 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056353 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-config-out\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056910 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-kube-rbac-proxy\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.056982 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-trusted-ca-bundle\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057018 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-config\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057091 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-thanos-prometheus-http-client-file\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057132 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-db\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057162 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-web-config\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057194 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-metrics-client-ca\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057219 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"41d60c17-e90f-47a7-b730-cdcacdbd51df\" (UID: \"41d60c17-e90f-47a7-b730-cdcacdbd51df\") " Jun 03 15:05:49.057343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057226 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:49.057970 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057465 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.057970 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.057692 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:49.058420 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.058390 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:49.059237 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.059209 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:49.059327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.059260 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:49.059386 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.059358 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:05:49.059859 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.059689 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:05:49.062357 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062257 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.062357 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062274 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-config-out" (OuterVolumeSpecName: "config-out") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:05:49.062357 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062321 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.062605 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062581 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.062786 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062757 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.062912 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062873 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.062912 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062886 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-kube-api-access-frzxt" (OuterVolumeSpecName: "kube-api-access-frzxt") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "kube-api-access-frzxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:05:49.063035 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062953 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.063035 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.062989 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.063732 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.063716 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-config" (OuterVolumeSpecName: "config") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.073051 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.073031 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-web-config" (OuterVolumeSpecName: "web-config") pod "41d60c17-e90f-47a7-b730-cdcacdbd51df" (UID: "41d60c17-e90f-47a7-b730-cdcacdbd51df"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:05:49.158689 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158652 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-db\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158689 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158686 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-web-config\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158689 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158698 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-metrics-client-ca\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158710 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158720 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-tls-assets\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158729 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158737 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158745 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frzxt\" (UniqueName: \"kubernetes.io/projected/41d60c17-e90f-47a7-b730-cdcacdbd51df-kube-api-access-frzxt\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158753 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158763 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158771 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-metrics-client-certs\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158779 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-grpc-tls\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158787 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41d60c17-e90f-47a7-b730-cdcacdbd51df-config-out\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158795 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-secret-kube-rbac-proxy\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158802 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41d60c17-e90f-47a7-b730-cdcacdbd51df-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158811 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-config\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.158913 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.158819 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/41d60c17-e90f-47a7-b730-cdcacdbd51df-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:05:49.730761 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730730 2574 generic.go:358] "Generic (PLEG): container finished" podID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" exitCode=0 Jun 03 15:05:49.730761 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730757 2574 generic.go:358] "Generic (PLEG): container finished" podID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" exitCode=0 Jun 03 15:05:49.730761 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730763 2574 generic.go:358] "Generic (PLEG): container finished" podID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" exitCode=0 Jun 03 15:05:49.730761 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730769 2574 generic.go:358] "Generic (PLEG): container finished" podID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" exitCode=0 Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730774 2574 generic.go:358] "Generic (PLEG): container finished" podID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" exitCode=0 Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730779 2574 generic.go:358] "Generic (PLEG): container finished" podID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" exitCode=0 Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730817 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerDied","Data":"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce"} Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730837 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730855 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerDied","Data":"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb"} Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730866 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerDied","Data":"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b"} Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730876 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerDied","Data":"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6"} Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730885 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerDied","Data":"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d"} Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730894 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerDied","Data":"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c"} Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730906 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"41d60c17-e90f-47a7-b730-cdcacdbd51df","Type":"ContainerDied","Data":"2a4974d5a491aaffe9f576b561c0d90b80aaa394b68788060babcb26f201f10c"} Jun 03 15:05:49.731047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.730920 2574 scope.go:117] "RemoveContainer" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" Jun 03 15:05:49.739041 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.739023 2574 scope.go:117] "RemoveContainer" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" Jun 03 15:05:49.745258 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.745242 2574 scope.go:117] "RemoveContainer" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" Jun 03 15:05:49.751345 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.751329 2574 scope.go:117] "RemoveContainer" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" Jun 03 15:05:49.755508 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.755483 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:05:49.760052 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.760006 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:05:49.760162 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.760145 2574 scope.go:117] "RemoveContainer" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" Jun 03 15:05:49.766953 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.766931 2574 scope.go:117] "RemoveContainer" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" Jun 03 15:05:49.774087 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.774068 2574 scope.go:117] "RemoveContainer" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" Jun 03 15:05:49.780855 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.780739 2574 scope.go:117] "RemoveContainer" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" Jun 03 15:05:49.781078 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:05:49.780979 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": container with ID starting with 73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce not found: ID does not exist" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" Jun 03 15:05:49.781078 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.781011 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce"} err="failed to get container status \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": rpc error: code = NotFound desc = could not find container \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": container with ID starting with 73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce not found: ID does not exist" Jun 03 15:05:49.781078 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.781046 2574 scope.go:117] "RemoveContainer" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" Jun 03 15:05:49.781269 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:05:49.781253 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": container with ID starting with 52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb not found: ID does not exist" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" Jun 03 15:05:49.781313 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.781278 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb"} err="failed to get container status \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": rpc error: code = NotFound desc = could not find container \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": container with ID starting with 52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb not found: ID does not exist" Jun 03 15:05:49.781313 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.781294 2574 scope.go:117] "RemoveContainer" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" Jun 03 15:05:49.781509 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:05:49.781494 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": container with ID starting with 41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b not found: ID does not exist" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" Jun 03 15:05:49.781571 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.781514 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b"} err="failed to get container status \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": rpc error: code = NotFound desc = could not find container \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": container with ID starting with 41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b not found: ID does not exist" Jun 03 15:05:49.781571 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.781527 2574 scope.go:117] "RemoveContainer" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" Jun 03 15:05:49.781795 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:05:49.781777 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": container with ID starting with 403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6 not found: ID does not exist" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" Jun 03 15:05:49.781842 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.781799 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6"} err="failed to get container status \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": rpc error: code = NotFound desc = could not find container \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": container with ID starting with 403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6 not found: ID does not exist" Jun 03 15:05:49.781842 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.781813 2574 scope.go:117] "RemoveContainer" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" Jun 03 15:05:49.782020 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:05:49.782005 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": container with ID starting with 0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d not found: ID does not exist" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" Jun 03 15:05:49.782056 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782025 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d"} err="failed to get container status \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": rpc error: code = NotFound desc = could not find container \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": container with ID starting with 0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d not found: ID does not exist" Jun 03 15:05:49.782056 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782039 2574 scope.go:117] "RemoveContainer" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" Jun 03 15:05:49.782268 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:05:49.782250 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": container with ID starting with d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c not found: ID does not exist" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" Jun 03 15:05:49.782303 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782275 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c"} err="failed to get container status \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": rpc error: code = NotFound desc = could not find container \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": container with ID starting with d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c not found: ID does not exist" Jun 03 15:05:49.782303 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782289 2574 scope.go:117] "RemoveContainer" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" Jun 03 15:05:49.782486 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:05:49.782470 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": container with ID starting with 9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f not found: ID does not exist" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" Jun 03 15:05:49.782530 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782490 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f"} err="failed to get container status \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": rpc error: code = NotFound desc = could not find container \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": container with ID starting with 9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f not found: ID does not exist" Jun 03 15:05:49.782530 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782504 2574 scope.go:117] "RemoveContainer" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" Jun 03 15:05:49.782728 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782710 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce"} err="failed to get container status \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": rpc error: code = NotFound desc = could not find container \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": container with ID starting with 73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce not found: ID does not exist" Jun 03 15:05:49.782795 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782732 2574 scope.go:117] "RemoveContainer" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" Jun 03 15:05:49.782941 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782921 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb"} err="failed to get container status \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": rpc error: code = NotFound desc = could not find container \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": container with ID starting with 52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb not found: ID does not exist" Jun 03 15:05:49.782984 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.782942 2574 scope.go:117] "RemoveContainer" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" Jun 03 15:05:49.783097 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.783080 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b"} err="failed to get container status \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": rpc error: code = NotFound desc = could not find container \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": container with ID starting with 41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b not found: ID does not exist" Jun 03 15:05:49.783133 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.783097 2574 scope.go:117] "RemoveContainer" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" Jun 03 15:05:49.783416 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.783364 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6"} err="failed to get container status \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": rpc error: code = NotFound desc = could not find container \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": container with ID starting with 403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6 not found: ID does not exist" Jun 03 15:05:49.783558 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.783418 2574 scope.go:117] "RemoveContainer" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" Jun 03 15:05:49.783997 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.783969 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d"} err="failed to get container status \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": rpc error: code = NotFound desc = could not find container \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": container with ID starting with 0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d not found: ID does not exist" Jun 03 15:05:49.783997 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.783995 2574 scope.go:117] "RemoveContainer" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" Jun 03 15:05:49.784342 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.784270 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c"} err="failed to get container status \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": rpc error: code = NotFound desc = could not find container \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": container with ID starting with d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c not found: ID does not exist" Jun 03 15:05:49.784342 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.784321 2574 scope.go:117] "RemoveContainer" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" Jun 03 15:05:49.784596 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.784574 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f"} err="failed to get container status \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": rpc error: code = NotFound desc = could not find container \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": container with ID starting with 9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f not found: ID does not exist" Jun 03 15:05:49.784680 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.784598 2574 scope.go:117] "RemoveContainer" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" Jun 03 15:05:49.784880 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.784862 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce"} err="failed to get container status \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": rpc error: code = NotFound desc = could not find container \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": container with ID starting with 73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce not found: ID does not exist" Jun 03 15:05:49.784924 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.784882 2574 scope.go:117] "RemoveContainer" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" Jun 03 15:05:49.785207 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.785184 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb"} err="failed to get container status \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": rpc error: code = NotFound desc = could not find container \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": container with ID starting with 52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb not found: ID does not exist" Jun 03 15:05:49.785267 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.785210 2574 scope.go:117] "RemoveContainer" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" Jun 03 15:05:49.785475 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.785436 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b"} err="failed to get container status \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": rpc error: code = NotFound desc = could not find container \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": container with ID starting with 41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b not found: ID does not exist" Jun 03 15:05:49.785541 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.785477 2574 scope.go:117] "RemoveContainer" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" Jun 03 15:05:49.785714 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.785698 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:05:49.785802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.785697 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6"} err="failed to get container status \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": rpc error: code = NotFound desc = could not find container \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": container with ID starting with 403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6 not found: ID does not exist" Jun 03 15:05:49.785802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.785801 2574 scope.go:117] "RemoveContainer" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" Jun 03 15:05:49.786040 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786025 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="init-config-reloader" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786043 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="init-config-reloader" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786051 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="prometheus" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786061 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="prometheus" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786070 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="config-reloader" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786079 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="config-reloader" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786088 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="thanos-sidecar" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786093 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="thanos-sidecar" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786098 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy-web" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786103 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy-web" Jun 03 15:05:49.786105 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786108 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786114 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786122 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy-thanos" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786127 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy-thanos" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786046 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d"} err="failed to get container status \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": rpc error: code = NotFound desc = could not find container \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": container with ID starting with 0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d not found: ID does not exist" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786148 2574 scope.go:117] "RemoveContainer" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786186 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy-thanos" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786195 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="prometheus" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786200 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="thanos-sidecar" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786206 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786212 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="kube-rbac-proxy-web" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786219 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" containerName="config-reloader" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786405 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c"} err="failed to get container status \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": rpc error: code = NotFound desc = could not find container \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": container with ID starting with d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c not found: ID does not exist" Jun 03 15:05:49.786587 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786427 2574 scope.go:117] "RemoveContainer" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" Jun 03 15:05:49.787044 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786726 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f"} err="failed to get container status \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": rpc error: code = NotFound desc = could not find container \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": container with ID starting with 9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f not found: ID does not exist" Jun 03 15:05:49.787044 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786745 2574 scope.go:117] "RemoveContainer" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" Jun 03 15:05:49.787044 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.786988 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce"} err="failed to get container status \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": rpc error: code = NotFound desc = could not find container \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": container with ID starting with 73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce not found: ID does not exist" Jun 03 15:05:49.787044 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.787008 2574 scope.go:117] "RemoveContainer" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" Jun 03 15:05:49.787267 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.787247 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb"} err="failed to get container status \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": rpc error: code = NotFound desc = could not find container \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": container with ID starting with 52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb not found: ID does not exist" Jun 03 15:05:49.787320 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.787268 2574 scope.go:117] "RemoveContainer" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" Jun 03 15:05:49.787562 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.787544 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b"} err="failed to get container status \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": rpc error: code = NotFound desc = could not find container \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": container with ID starting with 41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b not found: ID does not exist" Jun 03 15:05:49.787613 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.787563 2574 scope.go:117] "RemoveContainer" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" Jun 03 15:05:49.787794 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.787773 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6"} err="failed to get container status \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": rpc error: code = NotFound desc = could not find container \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": container with ID starting with 403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6 not found: ID does not exist" Jun 03 15:05:49.787794 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.787794 2574 scope.go:117] "RemoveContainer" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" Jun 03 15:05:49.788032 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.788015 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d"} err="failed to get container status \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": rpc error: code = NotFound desc = could not find container \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": container with ID starting with 0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d not found: ID does not exist" Jun 03 15:05:49.788032 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.788032 2574 scope.go:117] "RemoveContainer" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" Jun 03 15:05:49.788274 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.788253 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c"} err="failed to get container status \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": rpc error: code = NotFound desc = could not find container \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": container with ID starting with d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c not found: ID does not exist" Jun 03 15:05:49.788352 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.788277 2574 scope.go:117] "RemoveContainer" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" Jun 03 15:05:49.788555 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.788538 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f"} err="failed to get container status \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": rpc error: code = NotFound desc = could not find container \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": container with ID starting with 9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f not found: ID does not exist" Jun 03 15:05:49.788606 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.788556 2574 scope.go:117] "RemoveContainer" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" Jun 03 15:05:49.789067 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.788786 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce"} err="failed to get container status \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": rpc error: code = NotFound desc = could not find container \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": container with ID starting with 73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce not found: ID does not exist" Jun 03 15:05:49.789067 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.789067 2574 scope.go:117] "RemoveContainer" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" Jun 03 15:05:49.789541 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.789284 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.789541 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.789296 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb"} err="failed to get container status \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": rpc error: code = NotFound desc = could not find container \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": container with ID starting with 52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb not found: ID does not exist" Jun 03 15:05:49.789541 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.789311 2574 scope.go:117] "RemoveContainer" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" Jun 03 15:05:49.789957 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.789868 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b"} err="failed to get container status \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": rpc error: code = NotFound desc = could not find container \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": container with ID starting with 41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b not found: ID does not exist" Jun 03 15:05:49.789957 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.789885 2574 scope.go:117] "RemoveContainer" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" Jun 03 15:05:49.790196 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.790136 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6"} err="failed to get container status \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": rpc error: code = NotFound desc = could not find container \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": container with ID starting with 403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6 not found: ID does not exist" Jun 03 15:05:49.790196 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.790151 2574 scope.go:117] "RemoveContainer" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" Jun 03 15:05:49.790484 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.790375 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d"} err="failed to get container status \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": rpc error: code = NotFound desc = could not find container \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": container with ID starting with 0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d not found: ID does not exist" Jun 03 15:05:49.790484 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.790401 2574 scope.go:117] "RemoveContainer" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" Jun 03 15:05:49.790713 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.790633 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c"} err="failed to get container status \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": rpc error: code = NotFound desc = could not find container \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": container with ID starting with d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c not found: ID does not exist" Jun 03 15:05:49.790713 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.790655 2574 scope.go:117] "RemoveContainer" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" Jun 03 15:05:49.790956 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.790854 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f"} err="failed to get container status \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": rpc error: code = NotFound desc = could not find container \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": container with ID starting with 9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f not found: ID does not exist" Jun 03 15:05:49.790956 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.790900 2574 scope.go:117] "RemoveContainer" containerID="73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce" Jun 03 15:05:49.791159 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.791130 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce"} err="failed to get container status \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": rpc error: code = NotFound desc = could not find container \"73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce\": container with ID starting with 73562f4cc1472db85fd0890a016901dbcd54041a205b12ebb1037e8e1e8530ce not found: ID does not exist" Jun 03 15:05:49.791159 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.791149 2574 scope.go:117] "RemoveContainer" containerID="52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb" Jun 03 15:05:49.791402 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.791383 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb"} err="failed to get container status \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": rpc error: code = NotFound desc = could not find container \"52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb\": container with ID starting with 52509230c6f1d1a464704686a7b31612c35211d803dcc301f66f46dc63763ffb not found: ID does not exist" Jun 03 15:05:49.791507 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.791401 2574 scope.go:117] "RemoveContainer" containerID="41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b" Jun 03 15:05:49.791682 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.791657 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b"} err="failed to get container status \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": rpc error: code = NotFound desc = could not find container \"41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b\": container with ID starting with 41fe43df7fd11cbc863f07f7dcf60e6158af05be432f1d30d7331a97b1e73f4b not found: ID does not exist" Jun 03 15:05:49.791755 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.791685 2574 scope.go:117] "RemoveContainer" containerID="403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6" Jun 03 15:05:49.791936 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.791912 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6"} err="failed to get container status \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": rpc error: code = NotFound desc = could not find container \"403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6\": container with ID starting with 403e2ac6b7fdb06f1b61cf70880344a3a23d028a3abc670e7eb519b1966437c6 not found: ID does not exist" Jun 03 15:05:49.792014 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.791939 2574 scope.go:117] "RemoveContainer" containerID="0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d" Jun 03 15:05:49.792229 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792205 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d"} err="failed to get container status \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": rpc error: code = NotFound desc = could not find container \"0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d\": container with ID starting with 0ad533b2dda300f2b9c4caca2fad04ca9f845ea0ed2ac812caadfaf9818b309d not found: ID does not exist" Jun 03 15:05:49.792327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792231 2574 scope.go:117] "RemoveContainer" containerID="d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c" Jun 03 15:05:49.792536 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792515 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 03 15:05:49.792662 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792588 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c"} err="failed to get container status \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": rpc error: code = NotFound desc = could not find container \"d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c\": container with ID starting with d863ed0ee10267e4679318825d0f0cfa726186ac2f42e8db4f9661b4866ac75c not found: ID does not exist" Jun 03 15:05:49.792662 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792613 2574 scope.go:117] "RemoveContainer" containerID="9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f" Jun 03 15:05:49.792886 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792756 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 03 15:05:49.792886 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792785 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 03 15:05:49.792886 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792828 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 03 15:05:49.793039 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.792907 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f"} err="failed to get container status \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": rpc error: code = NotFound desc = could not find container \"9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f\": container with ID starting with 9f5fa12bb9d837bcec79890dc6da3cda2b08334255c87f7e85cf48038c53d03f not found: ID does not exist" Jun 03 15:05:49.793259 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793238 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 03 15:05:49.793360 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793334 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 03 15:05:49.793360 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793349 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 03 15:05:49.793476 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793351 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-359t9en0l9e0t\"" Jun 03 15:05:49.793476 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793429 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wdmmx\"" Jun 03 15:05:49.793646 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793628 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 03 15:05:49.793735 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793659 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 03 15:05:49.793805 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793782 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 03 15:05:49.793897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.793879 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 03 15:05:49.796616 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.796598 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 03 15:05:49.799174 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.799149 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 03 15:05:49.802499 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.802474 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:05:49.864769 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.864710 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.864958 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.864776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2a7d768-c503-45f1-8049-b4f6bea04dbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.864958 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.864868 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2a7d768-c503-45f1-8049-b4f6bea04dbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.864958 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.864899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.864958 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.864921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.864958 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.864937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865142 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.864984 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865142 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865142 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865142 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865055 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-config\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865142 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865076 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865142 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865130 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865344 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56lbm\" (UniqueName: \"kubernetes.io/projected/a2a7d768-c503-45f1-8049-b4f6bea04dbe-kube-api-access-56lbm\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865344 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865344 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865344 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865254 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865344 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.865344 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.865290 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966374 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966332 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966374 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966383 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56lbm\" (UniqueName: \"kubernetes.io/projected/a2a7d768-c503-45f1-8049-b4f6bea04dbe-kube-api-access-56lbm\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966607 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966402 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966607 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966525 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966607 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966572 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966751 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966611 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966751 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966637 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966751 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966682 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966751 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966720 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2a7d768-c503-45f1-8049-b4f6bea04dbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966937 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966768 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2a7d768-c503-45f1-8049-b4f6bea04dbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966937 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966804 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966937 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966824 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966937 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966836 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966937 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966866 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.966937 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966908 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.967208 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966934 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.967208 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.966962 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.967208 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.967011 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-config\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.967208 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.967036 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.967904 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.967878 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.968882 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.968559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.970255 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.969969 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2a7d768-c503-45f1-8049-b4f6bea04dbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.970255 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.970040 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.970255 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.970086 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.970255 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.970153 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.970255 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.970157 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.970607 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.970478 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.970810 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.970758 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.970810 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.970841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.971004 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.970989 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a2a7d768-c503-45f1-8049-b4f6bea04dbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.972579 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.972552 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.972735 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.972712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.972982 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.972963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-config\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.973021 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.972973 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2a7d768-c503-45f1-8049-b4f6bea04dbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.973226 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.973209 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a2a7d768-c503-45f1-8049-b4f6bea04dbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:49.975812 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:49.975791 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56lbm\" (UniqueName: \"kubernetes.io/projected/a2a7d768-c503-45f1-8049-b4f6bea04dbe-kube-api-access-56lbm\") pod \"prometheus-k8s-0\" (UID: \"a2a7d768-c503-45f1-8049-b4f6bea04dbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:50.108254 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:50.108207 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:05:50.208403 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:50.208372 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41d60c17-e90f-47a7-b730-cdcacdbd51df" path="/var/lib/kubelet/pods/41d60c17-e90f-47a7-b730-cdcacdbd51df/volumes" Jun 03 15:05:50.245162 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:50.245122 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 03 15:05:50.247754 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:05:50.247725 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2a7d768_c503_45f1_8049_b4f6bea04dbe.slice/crio-155bde95f762954d2249cf0075a8b4005e7bf8dd3936ce16f78fe1c4902384cd WatchSource:0}: Error finding container 155bde95f762954d2249cf0075a8b4005e7bf8dd3936ce16f78fe1c4902384cd: Status 404 returned error can't find the container with id 155bde95f762954d2249cf0075a8b4005e7bf8dd3936ce16f78fe1c4902384cd Jun 03 15:05:50.735115 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:50.735079 2574 generic.go:358] "Generic (PLEG): container finished" podID="a2a7d768-c503-45f1-8049-b4f6bea04dbe" containerID="e8246169625f65d9b0a69e980e49f2087c88c2a4359d062a96464172cc2a54e2" exitCode=0 Jun 03 15:05:50.735311 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:50.735167 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a7d768-c503-45f1-8049-b4f6bea04dbe","Type":"ContainerDied","Data":"e8246169625f65d9b0a69e980e49f2087c88c2a4359d062a96464172cc2a54e2"} Jun 03 15:05:50.735311 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:50.735210 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a7d768-c503-45f1-8049-b4f6bea04dbe","Type":"ContainerStarted","Data":"155bde95f762954d2249cf0075a8b4005e7bf8dd3936ce16f78fe1c4902384cd"} Jun 03 15:05:51.742009 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:51.741977 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a7d768-c503-45f1-8049-b4f6bea04dbe","Type":"ContainerStarted","Data":"31bd3d1a08bb5daaef16cf22d4fa0bbe46b81385aaada15f6f5ea7cdc462db9f"} Jun 03 15:05:51.742009 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:51.742010 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a7d768-c503-45f1-8049-b4f6bea04dbe","Type":"ContainerStarted","Data":"198c065b63306b5b09f797fa28c8ee722f19cf6cfa5f2db24fcb59a446296b4f"} Jun 03 15:05:51.742422 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:51.742020 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a7d768-c503-45f1-8049-b4f6bea04dbe","Type":"ContainerStarted","Data":"1f4e6b9342d61f00d6bfcf6fdf06d5c7feee4895c96e95998de994a073a16c0b"} Jun 03 15:05:51.742422 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:51.742029 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a7d768-c503-45f1-8049-b4f6bea04dbe","Type":"ContainerStarted","Data":"6952f3c623d5f89743afc4b9980b80c25d9152e5ef04bb14a3d3496772793024"} Jun 03 15:05:51.742422 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:51.742037 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a7d768-c503-45f1-8049-b4f6bea04dbe","Type":"ContainerStarted","Data":"d144822334ad534dde194019d967441d9cc53c4454fb7146f4e08501c622be29"} Jun 03 15:05:51.742422 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:51.742045 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a2a7d768-c503-45f1-8049-b4f6bea04dbe","Type":"ContainerStarted","Data":"c5b54e2204a5d117afe989e20ba2ec6310c3a423a4061b57237060009bd205c2"} Jun 03 15:05:51.777261 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:51.777207 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.777191161 podStartE2EDuration="2.777191161s" podCreationTimestamp="2026-06-03 15:05:49 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:05:51.77455633 +0000 UTC m=+136.097713642" watchObservedRunningTime="2026-06-03 15:05:51.777191161 +0000 UTC m=+136.100348464" Jun 03 15:05:55.108561 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:05:55.108521 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:06:50.108996 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:06:50.108954 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:06:50.124795 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:06:50.124768 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:06:50.915306 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:06:50.915278 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 03 15:07:40.435480 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.435425 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg"] Jun 03 15:07:40.437381 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.437365 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" Jun 03 15:07:40.440406 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.440386 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 15:07:40.441789 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.441772 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 15:07:40.441855 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.441798 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zl8xf\"" Jun 03 15:07:40.448882 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.448832 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg"] Jun 03 15:07:40.481362 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.481324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbf65ad5-8051-45aa-845e-7be369fff94e-tmp\") pod \"openshift-lws-operator-bfc7f696d-lrpbg\" (UID: \"dbf65ad5-8051-45aa-845e-7be369fff94e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" Jun 03 15:07:40.481553 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.481421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmggn\" (UniqueName: \"kubernetes.io/projected/dbf65ad5-8051-45aa-845e-7be369fff94e-kube-api-access-fmggn\") pod \"openshift-lws-operator-bfc7f696d-lrpbg\" (UID: \"dbf65ad5-8051-45aa-845e-7be369fff94e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" Jun 03 15:07:40.582248 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.582204 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmggn\" (UniqueName: \"kubernetes.io/projected/dbf65ad5-8051-45aa-845e-7be369fff94e-kube-api-access-fmggn\") pod \"openshift-lws-operator-bfc7f696d-lrpbg\" (UID: \"dbf65ad5-8051-45aa-845e-7be369fff94e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" Jun 03 15:07:40.582422 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.582261 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbf65ad5-8051-45aa-845e-7be369fff94e-tmp\") pod \"openshift-lws-operator-bfc7f696d-lrpbg\" (UID: \"dbf65ad5-8051-45aa-845e-7be369fff94e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" Jun 03 15:07:40.582610 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.582594 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dbf65ad5-8051-45aa-845e-7be369fff94e-tmp\") pod \"openshift-lws-operator-bfc7f696d-lrpbg\" (UID: \"dbf65ad5-8051-45aa-845e-7be369fff94e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" Jun 03 15:07:40.595835 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.595795 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmggn\" (UniqueName: \"kubernetes.io/projected/dbf65ad5-8051-45aa-845e-7be369fff94e-kube-api-access-fmggn\") pod \"openshift-lws-operator-bfc7f696d-lrpbg\" (UID: \"dbf65ad5-8051-45aa-845e-7be369fff94e\") " pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" Jun 03 15:07:40.756301 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.756215 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" Jun 03 15:07:40.885806 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:40.885731 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg"] Jun 03 15:07:40.888617 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:07:40.888589 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbf65ad5_8051_45aa_845e_7be369fff94e.slice/crio-5dd9730def4494cbde45a29abed74dfe02b26bd5180234fb2976443a21877af9 WatchSource:0}: Error finding container 5dd9730def4494cbde45a29abed74dfe02b26bd5180234fb2976443a21877af9: Status 404 returned error can't find the container with id 5dd9730def4494cbde45a29abed74dfe02b26bd5180234fb2976443a21877af9 Jun 03 15:07:41.033521 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:41.033416 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" event={"ID":"dbf65ad5-8051-45aa-845e-7be369fff94e","Type":"ContainerStarted","Data":"5dd9730def4494cbde45a29abed74dfe02b26bd5180234fb2976443a21877af9"} Jun 03 15:07:44.043702 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:44.043669 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" event={"ID":"dbf65ad5-8051-45aa-845e-7be369fff94e","Type":"ContainerStarted","Data":"77a3048c89b1faa4ca48b2e908d504a8da7e0a95634ae6af9a380c45b157d5cf"} Jun 03 15:07:44.064669 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:44.064624 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-bfc7f696d-lrpbg" podStartSLOduration=1.419004609 podStartE2EDuration="4.064610063s" podCreationTimestamp="2026-06-03 15:07:40 +0000 UTC" firstStartedPulling="2026-06-03 15:07:40.890204235 +0000 UTC m=+245.213361522" lastFinishedPulling="2026-06-03 15:07:43.535809685 +0000 UTC m=+247.858966976" observedRunningTime="2026-06-03 15:07:44.062746448 +0000 UTC m=+248.385903752" watchObservedRunningTime="2026-06-03 15:07:44.064610063 +0000 UTC m=+248.387767367" Jun 03 15:07:59.730864 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.730784 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g"] Jun 03 15:07:59.737013 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.736987 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.750350 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.750328 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g"] Jun 03 15:07:59.753609 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.753585 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 15:07:59.753734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.753615 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lq6j4\"" Jun 03 15:07:59.753734 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.753640 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 15:07:59.753858 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.753733 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 15:07:59.753858 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.753733 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 15:07:59.834438 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.834405 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba050a0b-854b-46fb-8f8a-e72c76148896-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.834655 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.834477 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba050a0b-854b-46fb-8f8a-e72c76148896-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.834655 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.834497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5224k\" (UniqueName: \"kubernetes.io/projected/ba050a0b-854b-46fb-8f8a-e72c76148896-kube-api-access-5224k\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.834655 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.834566 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba050a0b-854b-46fb-8f8a-e72c76148896-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.834655 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.834603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba050a0b-854b-46fb-8f8a-e72c76148896-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.935896 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.935860 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba050a0b-854b-46fb-8f8a-e72c76148896-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.935896 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.935899 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5224k\" (UniqueName: \"kubernetes.io/projected/ba050a0b-854b-46fb-8f8a-e72c76148896-kube-api-access-5224k\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.936149 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.935922 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba050a0b-854b-46fb-8f8a-e72c76148896-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.936149 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.935973 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba050a0b-854b-46fb-8f8a-e72c76148896-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.936149 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.936048 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba050a0b-854b-46fb-8f8a-e72c76148896-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.936371 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.936350 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ba050a0b-854b-46fb-8f8a-e72c76148896-manifests\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.938510 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.938482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba050a0b-854b-46fb-8f8a-e72c76148896-tmp\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.938637 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.938599 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba050a0b-854b-46fb-8f8a-e72c76148896-webhook-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.938721 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.938699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba050a0b-854b-46fb-8f8a-e72c76148896-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:07:59.950575 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:07:59.950551 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5224k\" (UniqueName: \"kubernetes.io/projected/ba050a0b-854b-46fb-8f8a-e72c76148896-kube-api-access-5224k\") pod \"opendatahub-operator-controller-manager-5678f4b79b-lh24g\" (UID: \"ba050a0b-854b-46fb-8f8a-e72c76148896\") " pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:08:00.047644 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:00.047555 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:08:00.182766 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:00.182728 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g"] Jun 03 15:08:00.187384 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:08:00.187352 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba050a0b_854b_46fb_8f8a_e72c76148896.slice/crio-613aa81ec417e4d95b09519ada8f810930bcfc5b9b34d7ad538692347260b3ab WatchSource:0}: Error finding container 613aa81ec417e4d95b09519ada8f810930bcfc5b9b34d7ad538692347260b3ab: Status 404 returned error can't find the container with id 613aa81ec417e4d95b09519ada8f810930bcfc5b9b34d7ad538692347260b3ab Jun 03 15:08:01.090430 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:01.090390 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" event={"ID":"ba050a0b-854b-46fb-8f8a-e72c76148896","Type":"ContainerStarted","Data":"613aa81ec417e4d95b09519ada8f810930bcfc5b9b34d7ad538692347260b3ab"} Jun 03 15:08:04.100410 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:04.100376 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" event={"ID":"ba050a0b-854b-46fb-8f8a-e72c76148896","Type":"ContainerStarted","Data":"5a768ab7bf598366cb292a6bf491d4debedcfed8bfdc4039a025124b257f3adb"} Jun 03 15:08:05.105032 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:05.104996 2574 generic.go:358] "Generic (PLEG): container finished" podID="ba050a0b-854b-46fb-8f8a-e72c76148896" containerID="5a768ab7bf598366cb292a6bf491d4debedcfed8bfdc4039a025124b257f3adb" exitCode=0 Jun 03 15:08:05.105419 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:05.105076 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" event={"ID":"ba050a0b-854b-46fb-8f8a-e72c76148896","Type":"ContainerDied","Data":"5a768ab7bf598366cb292a6bf491d4debedcfed8bfdc4039a025124b257f3adb"} Jun 03 15:08:06.109631 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:06.109595 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" event={"ID":"ba050a0b-854b-46fb-8f8a-e72c76148896","Type":"ContainerStarted","Data":"88424b43fac060d0f5f5cfc05d4200d6e25e9f12c227a4fd06c4134a1cb0d100"} Jun 03 15:08:06.110016 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:06.109726 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:08:06.207186 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:06.207118 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" podStartSLOduration=1.889347554 podStartE2EDuration="7.207100297s" podCreationTimestamp="2026-06-03 15:07:59 +0000 UTC" firstStartedPulling="2026-06-03 15:08:00.189165002 +0000 UTC m=+264.512322284" lastFinishedPulling="2026-06-03 15:08:05.506917729 +0000 UTC m=+269.830075027" observedRunningTime="2026-06-03 15:08:06.195902351 +0000 UTC m=+270.519059654" watchObservedRunningTime="2026-06-03 15:08:06.207100297 +0000 UTC m=+270.530257601" Jun 03 15:08:17.114003 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:17.113965 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5678f4b79b-lh24g" Jun 03 15:08:19.610435 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.610390 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8"] Jun 03 15:08:19.612616 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.612592 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.617306 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.617268 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 15:08:19.617458 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.617268 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 15:08:19.617458 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.617275 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 15:08:19.617458 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.617275 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 15:08:19.646641 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.646608 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8"] Jun 03 15:08:19.792799 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.792768 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4hk8\" (UniqueName: \"kubernetes.io/projected/602ce5db-9b49-4fb0-8476-d46d0c87012d-kube-api-access-p4hk8\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.792994 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.792867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602ce5db-9b49-4fb0-8476-d46d0c87012d-tls-certs\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.792994 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.792894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602ce5db-9b49-4fb0-8476-d46d0c87012d-tmp\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.894223 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.894131 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602ce5db-9b49-4fb0-8476-d46d0c87012d-tls-certs\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.894223 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.894166 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602ce5db-9b49-4fb0-8476-d46d0c87012d-tmp\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.894440 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.894295 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p4hk8\" (UniqueName: \"kubernetes.io/projected/602ce5db-9b49-4fb0-8476-d46d0c87012d-kube-api-access-p4hk8\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.896670 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.896640 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/602ce5db-9b49-4fb0-8476-d46d0c87012d-tmp\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.896851 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.896830 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/602ce5db-9b49-4fb0-8476-d46d0c87012d-tls-certs\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.933092 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.933059 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4hk8\" (UniqueName: \"kubernetes.io/projected/602ce5db-9b49-4fb0-8476-d46d0c87012d-kube-api-access-p4hk8\") pod \"kube-auth-proxy-6d85c64844-qdkt8\" (UID: \"602ce5db-9b49-4fb0-8476-d46d0c87012d\") " pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:19.958969 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.958936 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k"] Jun 03 15:08:19.961273 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.961253 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:19.964819 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.964794 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 15:08:19.965209 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.965189 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-v6lrr\"" Jun 03 15:08:19.965350 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.965334 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 15:08:19.965944 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:19.965932 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 15:08:20.002347 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.002316 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k"] Jun 03 15:08:20.095705 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.095669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bdc95c7-8334-4907-87e0-21b9599a1290-manager-config\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.095879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.095715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bdc95c7-8334-4907-87e0-21b9599a1290-cert\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.095879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.095741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bdc95c7-8334-4907-87e0-21b9599a1290-metrics-cert\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.095879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.095800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrkwx\" (UniqueName: \"kubernetes.io/projected/1bdc95c7-8334-4907-87e0-21b9599a1290-kube-api-access-qrkwx\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.197145 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.197068 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bdc95c7-8334-4907-87e0-21b9599a1290-manager-config\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.197145 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.197105 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bdc95c7-8334-4907-87e0-21b9599a1290-cert\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.197145 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.197123 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bdc95c7-8334-4907-87e0-21b9599a1290-metrics-cert\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.197342 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.197172 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrkwx\" (UniqueName: \"kubernetes.io/projected/1bdc95c7-8334-4907-87e0-21b9599a1290-kube-api-access-qrkwx\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.197744 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.197719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1bdc95c7-8334-4907-87e0-21b9599a1290-manager-config\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.199696 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.199678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1bdc95c7-8334-4907-87e0-21b9599a1290-cert\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.199808 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.199742 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1bdc95c7-8334-4907-87e0-21b9599a1290-metrics-cert\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.217264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.217239 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrkwx\" (UniqueName: \"kubernetes.io/projected/1bdc95c7-8334-4907-87e0-21b9599a1290-kube-api-access-qrkwx\") pod \"lws-controller-manager-f7c5db56c-t2x9k\" (UID: \"1bdc95c7-8334-4907-87e0-21b9599a1290\") " pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.223066 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.223049 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" Jun 03 15:08:20.271703 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.271680 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:20.372602 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:20.372549 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8"] Jun 03 15:08:20.375842 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:08:20.375813 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602ce5db_9b49_4fb0_8476_d46d0c87012d.slice/crio-742b69b35d160eac330cd7baaf13b66a05d3ef27f8130f7f40520f3b818b51d1 WatchSource:0}: Error finding container 742b69b35d160eac330cd7baaf13b66a05d3ef27f8130f7f40520f3b818b51d1: Status 404 returned error can't find the container with id 742b69b35d160eac330cd7baaf13b66a05d3ef27f8130f7f40520f3b818b51d1 Jun 03 15:08:21.152872 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:21.152839 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" event={"ID":"602ce5db-9b49-4fb0-8476-d46d0c87012d","Type":"ContainerStarted","Data":"742b69b35d160eac330cd7baaf13b66a05d3ef27f8130f7f40520f3b818b51d1"} Jun 03 15:08:21.343702 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:21.343646 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k"] Jun 03 15:08:21.348038 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:08:21.348009 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdc95c7_8334_4907_87e0_21b9599a1290.slice/crio-8b568786fd9f89aba6461e224079a6d4763dac7c5a5fe52219fbc82f3e3cf96c WatchSource:0}: Error finding container 8b568786fd9f89aba6461e224079a6d4763dac7c5a5fe52219fbc82f3e3cf96c: Status 404 returned error can't find the container with id 8b568786fd9f89aba6461e224079a6d4763dac7c5a5fe52219fbc82f3e3cf96c Jun 03 15:08:22.157096 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:22.157056 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" event={"ID":"1bdc95c7-8334-4907-87e0-21b9599a1290","Type":"ContainerStarted","Data":"8b568786fd9f89aba6461e224079a6d4763dac7c5a5fe52219fbc82f3e3cf96c"} Jun 03 15:08:24.169037 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:24.168998 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" event={"ID":"602ce5db-9b49-4fb0-8476-d46d0c87012d","Type":"ContainerStarted","Data":"64aa4bd39831325ad860f1ddd56dd35cf636e081a04d8050f451114f2e740608"} Jun 03 15:08:24.170386 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:24.170329 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" event={"ID":"1bdc95c7-8334-4907-87e0-21b9599a1290","Type":"ContainerStarted","Data":"c2ede3de956f73d4e32adc7e4a0ede5da87b1764c3334554d9e694d16c1a3be8"} Jun 03 15:08:24.170632 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:24.170616 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:24.189227 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:24.189187 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6d85c64844-qdkt8" podStartSLOduration=1.843400775 podStartE2EDuration="5.189175566s" podCreationTimestamp="2026-06-03 15:08:19 +0000 UTC" firstStartedPulling="2026-06-03 15:08:20.377402169 +0000 UTC m=+284.700559450" lastFinishedPulling="2026-06-03 15:08:23.723176946 +0000 UTC m=+288.046334241" observedRunningTime="2026-06-03 15:08:24.187844441 +0000 UTC m=+288.511001764" watchObservedRunningTime="2026-06-03 15:08:24.189175566 +0000 UTC m=+288.512332869" Jun 03 15:08:24.205891 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:24.205840 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" podStartSLOduration=2.838100337 podStartE2EDuration="5.205825694s" podCreationTimestamp="2026-06-03 15:08:19 +0000 UTC" firstStartedPulling="2026-06-03 15:08:21.34966088 +0000 UTC m=+285.672818162" lastFinishedPulling="2026-06-03 15:08:23.717386239 +0000 UTC m=+288.040543519" observedRunningTime="2026-06-03 15:08:24.204749616 +0000 UTC m=+288.527906920" watchObservedRunningTime="2026-06-03 15:08:24.205825694 +0000 UTC m=+288.528982998" Jun 03 15:08:35.175887 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:35.175852 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f7c5db56c-t2x9k" Jun 03 15:08:36.128326 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:36.128291 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:08:36.128517 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:36.128423 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:08:36.134591 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:08:36.134559 2574 kubelet.go:1628] "Image garbage collection succeeded" Jun 03 15:09:57.621377 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.621337 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq"] Jun 03 15:09:57.623428 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.623407 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:09:57.627966 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.627942 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rfrzl\"" Jun 03 15:09:57.628085 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.628029 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 15:09:57.628174 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.628154 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 15:09:57.643435 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.643408 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq"] Jun 03 15:09:57.672017 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.671980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec88f5a-24e7-4165-b38a-410e139e3837-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qpzjq\" (UID: \"9ec88f5a-24e7-4165-b38a-410e139e3837\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:09:57.672181 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.672062 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmlp\" (UniqueName: \"kubernetes.io/projected/9ec88f5a-24e7-4165-b38a-410e139e3837-kube-api-access-xwmlp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qpzjq\" (UID: \"9ec88f5a-24e7-4165-b38a-410e139e3837\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:09:57.772769 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.772730 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmlp\" (UniqueName: \"kubernetes.io/projected/9ec88f5a-24e7-4165-b38a-410e139e3837-kube-api-access-xwmlp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qpzjq\" (UID: \"9ec88f5a-24e7-4165-b38a-410e139e3837\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:09:57.772971 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.772795 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec88f5a-24e7-4165-b38a-410e139e3837-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qpzjq\" (UID: \"9ec88f5a-24e7-4165-b38a-410e139e3837\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:09:57.773212 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.773188 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec88f5a-24e7-4165-b38a-410e139e3837-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qpzjq\" (UID: \"9ec88f5a-24e7-4165-b38a-410e139e3837\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:09:57.785138 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.785112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmlp\" (UniqueName: \"kubernetes.io/projected/9ec88f5a-24e7-4165-b38a-410e139e3837-kube-api-access-xwmlp\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-qpzjq\" (UID: \"9ec88f5a-24e7-4165-b38a-410e139e3837\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:09:57.933383 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:57.933278 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:09:58.072339 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:58.072303 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq"] Jun 03 15:09:58.076224 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:09:58.076193 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec88f5a_24e7_4165_b38a_410e139e3837.slice/crio-5b465a5a7afd0362a3d6689c121eb3223a83ef71fad0d1f399b06f5479483bc0 WatchSource:0}: Error finding container 5b465a5a7afd0362a3d6689c121eb3223a83ef71fad0d1f399b06f5479483bc0: Status 404 returned error can't find the container with id 5b465a5a7afd0362a3d6689c121eb3223a83ef71fad0d1f399b06f5479483bc0 Jun 03 15:09:58.079011 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:58.078993 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:09:58.440288 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:09:58.440245 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" event={"ID":"9ec88f5a-24e7-4165-b38a-410e139e3837","Type":"ContainerStarted","Data":"5b465a5a7afd0362a3d6689c121eb3223a83ef71fad0d1f399b06f5479483bc0"} Jun 03 15:10:04.462623 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:04.462587 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" event={"ID":"9ec88f5a-24e7-4165-b38a-410e139e3837","Type":"ContainerStarted","Data":"d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021"} Jun 03 15:10:04.463100 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:04.462699 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:10:07.096439 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.096380 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" podStartSLOduration=4.38931579 podStartE2EDuration="10.096363403s" podCreationTimestamp="2026-06-03 15:09:57 +0000 UTC" firstStartedPulling="2026-06-03 15:09:58.079118867 +0000 UTC m=+382.402276148" lastFinishedPulling="2026-06-03 15:10:03.78616648 +0000 UTC m=+388.109323761" observedRunningTime="2026-06-03 15:10:04.518435125 +0000 UTC m=+388.841592430" watchObservedRunningTime="2026-06-03 15:10:07.096363403 +0000 UTC m=+391.419520705" Jun 03 15:10:07.096822 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.096556 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz"] Jun 03 15:10:07.098534 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.098519 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.102412 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.102384 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 15:10:07.102412 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.102403 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 15:10:07.102622 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.102416 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z8kb7\"" Jun 03 15:10:07.155681 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.155648 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz"] Jun 03 15:10:07.159432 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.159404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44kg2\" (UniqueName: \"kubernetes.io/projected/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-kube-api-access-44kg2\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.159584 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.159480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.159584 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.159533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.260624 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.260577 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.260624 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.260640 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-44kg2\" (UniqueName: \"kubernetes.io/projected/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-kube-api-access-44kg2\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.260956 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.260679 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.261283 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.261259 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.263251 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.263228 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.297307 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.297267 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44kg2\" (UniqueName: \"kubernetes.io/projected/1832330e-cdf1-4a87-b204-32f6bbdfcbf6-kube-api-access-44kg2\") pod \"kuadrant-console-plugin-6cb54b5c86-zsxkz\" (UID: \"1832330e-cdf1-4a87-b204-32f6bbdfcbf6\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.407055 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.406974 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" Jun 03 15:10:07.608873 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:07.608848 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz"] Jun 03 15:10:07.610329 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:10:07.610300 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1832330e_cdf1_4a87_b204_32f6bbdfcbf6.slice/crio-d8671f84882b1d19b02b2d2dacc7eaeb366adb9e743ccf654505e4c899796a65 WatchSource:0}: Error finding container d8671f84882b1d19b02b2d2dacc7eaeb366adb9e743ccf654505e4c899796a65: Status 404 returned error can't find the container with id d8671f84882b1d19b02b2d2dacc7eaeb366adb9e743ccf654505e4c899796a65 Jun 03 15:10:08.479055 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:08.479015 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" event={"ID":"1832330e-cdf1-4a87-b204-32f6bbdfcbf6","Type":"ContainerStarted","Data":"d8671f84882b1d19b02b2d2dacc7eaeb366adb9e743ccf654505e4c899796a65"} Jun 03 15:10:15.468643 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:15.468611 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:10:17.577300 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.577252 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq"] Jun 03 15:10:17.577808 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.577573 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" podUID="9ec88f5a-24e7-4165-b38a-410e139e3837" containerName="manager" containerID="cri-o://d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021" gracePeriod=2 Jun 03 15:10:17.663491 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.663435 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq"] Jun 03 15:10:17.665204 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.665178 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf"] Jun 03 15:10:17.665661 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.665646 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec88f5a-24e7-4165-b38a-410e139e3837" containerName="manager" Jun 03 15:10:17.665735 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.665665 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec88f5a-24e7-4165-b38a-410e139e3837" containerName="manager" Jun 03 15:10:17.665788 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.665741 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="9ec88f5a-24e7-4165-b38a-410e139e3837" containerName="manager" Jun 03 15:10:17.668744 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.668707 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:17.670625 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.670595 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf"] Jun 03 15:10:17.757000 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.756907 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/168bc4db-eb89-44e5-9f7f-b03623997724-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8pvrf\" (UID: \"168bc4db-eb89-44e5-9f7f-b03623997724\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:17.757176 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.757023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr8pv\" (UniqueName: \"kubernetes.io/projected/168bc4db-eb89-44e5-9f7f-b03623997724-kube-api-access-lr8pv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8pvrf\" (UID: \"168bc4db-eb89-44e5-9f7f-b03623997724\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:17.838191 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.838126 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:10:17.842345 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.842316 2574 status_manager.go:895] "Failed to get status for pod" podUID="9ec88f5a-24e7-4165-b38a-410e139e3837" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-qpzjq\" is forbidden: User \"system:node:ip-10-0-133-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-0.ec2.internal' and this object" Jun 03 15:10:17.857825 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.857787 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/168bc4db-eb89-44e5-9f7f-b03623997724-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8pvrf\" (UID: \"168bc4db-eb89-44e5-9f7f-b03623997724\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:17.857974 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.857839 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lr8pv\" (UniqueName: \"kubernetes.io/projected/168bc4db-eb89-44e5-9f7f-b03623997724-kube-api-access-lr8pv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8pvrf\" (UID: \"168bc4db-eb89-44e5-9f7f-b03623997724\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:17.858258 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.858226 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/168bc4db-eb89-44e5-9f7f-b03623997724-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8pvrf\" (UID: \"168bc4db-eb89-44e5-9f7f-b03623997724\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:17.873386 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.873359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr8pv\" (UniqueName: \"kubernetes.io/projected/168bc4db-eb89-44e5-9f7f-b03623997724-kube-api-access-lr8pv\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-8pvrf\" (UID: \"168bc4db-eb89-44e5-9f7f-b03623997724\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:17.958343 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.958306 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec88f5a-24e7-4165-b38a-410e139e3837-extensions-socket-volume\") pod \"9ec88f5a-24e7-4165-b38a-410e139e3837\" (UID: \"9ec88f5a-24e7-4165-b38a-410e139e3837\") " Jun 03 15:10:17.958547 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.958380 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwmlp\" (UniqueName: \"kubernetes.io/projected/9ec88f5a-24e7-4165-b38a-410e139e3837-kube-api-access-xwmlp\") pod \"9ec88f5a-24e7-4165-b38a-410e139e3837\" (UID: \"9ec88f5a-24e7-4165-b38a-410e139e3837\") " Jun 03 15:10:17.958894 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.958866 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec88f5a-24e7-4165-b38a-410e139e3837-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9ec88f5a-24e7-4165-b38a-410e139e3837" (UID: "9ec88f5a-24e7-4165-b38a-410e139e3837"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:10:17.960961 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.960938 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec88f5a-24e7-4165-b38a-410e139e3837-kube-api-access-xwmlp" (OuterVolumeSpecName: "kube-api-access-xwmlp") pod "9ec88f5a-24e7-4165-b38a-410e139e3837" (UID: "9ec88f5a-24e7-4165-b38a-410e139e3837"). InnerVolumeSpecName "kube-api-access-xwmlp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:10:17.989037 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:17.988999 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:18.060113 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.060072 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9ec88f5a-24e7-4165-b38a-410e139e3837-extensions-socket-volume\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:10:18.060113 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.060112 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwmlp\" (UniqueName: \"kubernetes.io/projected/9ec88f5a-24e7-4165-b38a-410e139e3837-kube-api-access-xwmlp\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:10:18.208806 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.208714 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec88f5a-24e7-4165-b38a-410e139e3837" path="/var/lib/kubelet/pods/9ec88f5a-24e7-4165-b38a-410e139e3837/volumes" Jun 03 15:10:18.513232 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.513154 2574 generic.go:358] "Generic (PLEG): container finished" podID="9ec88f5a-24e7-4165-b38a-410e139e3837" containerID="d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021" exitCode=0 Jun 03 15:10:18.513398 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.513226 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-qpzjq" Jun 03 15:10:18.513398 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.513244 2574 scope.go:117] "RemoveContainer" containerID="d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021" Jun 03 15:10:18.919894 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.919862 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9"] Jun 03 15:10:18.928819 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.928779 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:18.953747 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:18.953692 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9"] Jun 03 15:10:19.069032 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:19.068997 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef39b6a6-df9c-49e6-8372-b434eaa93c8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vkfq9\" (UID: \"ef39b6a6-df9c-49e6-8372-b434eaa93c8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:19.069210 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:19.069059 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2dx7\" (UniqueName: \"kubernetes.io/projected/ef39b6a6-df9c-49e6-8372-b434eaa93c8e-kube-api-access-m2dx7\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vkfq9\" (UID: \"ef39b6a6-df9c-49e6-8372-b434eaa93c8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:19.170533 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:19.170422 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef39b6a6-df9c-49e6-8372-b434eaa93c8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vkfq9\" (UID: \"ef39b6a6-df9c-49e6-8372-b434eaa93c8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:19.170533 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:19.170522 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2dx7\" (UniqueName: \"kubernetes.io/projected/ef39b6a6-df9c-49e6-8372-b434eaa93c8e-kube-api-access-m2dx7\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vkfq9\" (UID: \"ef39b6a6-df9c-49e6-8372-b434eaa93c8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:19.170875 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:19.170848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef39b6a6-df9c-49e6-8372-b434eaa93c8e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vkfq9\" (UID: \"ef39b6a6-df9c-49e6-8372-b434eaa93c8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:19.183353 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:19.183328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2dx7\" (UniqueName: \"kubernetes.io/projected/ef39b6a6-df9c-49e6-8372-b434eaa93c8e-kube-api-access-m2dx7\") pod \"kuadrant-operator-controller-manager-55c7f4c975-vkfq9\" (UID: \"ef39b6a6-df9c-49e6-8372-b434eaa93c8e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:19.241320 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:19.241285 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:31.949315 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:31.949008 2574 scope.go:117] "RemoveContainer" containerID="d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021" Jun 03 15:10:31.949636 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:10:31.949393 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021\": container with ID starting with d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021 not found: ID does not exist" containerID="d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021" Jun 03 15:10:31.949636 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:31.949435 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021"} err="failed to get container status \"d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021\": rpc error: code = NotFound desc = could not find container \"d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021\": container with ID starting with d6975360020f07e01fbef6ad481a80b987a8da09ef3009b9674999cbc0903021 not found: ID does not exist" Jun 03 15:10:32.157883 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.157858 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9"] Jun 03 15:10:32.158676 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:10:32.158651 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef39b6a6_df9c_49e6_8372_b434eaa93c8e.slice/crio-a0e9a0c96e91ae24187b7c085c98227cb68d37b5d4de8dd2220bc856fe2ac6ef WatchSource:0}: Error finding container a0e9a0c96e91ae24187b7c085c98227cb68d37b5d4de8dd2220bc856fe2ac6ef: Status 404 returned error can't find the container with id a0e9a0c96e91ae24187b7c085c98227cb68d37b5d4de8dd2220bc856fe2ac6ef Jun 03 15:10:32.174857 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.174834 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf"] Jun 03 15:10:32.175359 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:10:32.175329 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod168bc4db_eb89_44e5_9f7f_b03623997724.slice/crio-4d92f916507a4bec2f53e7acc24ae2aeb930cfe22ee44e9f42d8659e4d769b14 WatchSource:0}: Error finding container 4d92f916507a4bec2f53e7acc24ae2aeb930cfe22ee44e9f42d8659e4d769b14: Status 404 returned error can't find the container with id 4d92f916507a4bec2f53e7acc24ae2aeb930cfe22ee44e9f42d8659e4d769b14 Jun 03 15:10:32.566698 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.566615 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" event={"ID":"ef39b6a6-df9c-49e6-8372-b434eaa93c8e","Type":"ContainerStarted","Data":"580006e0ea69917c23c375279bba08cc0b72d37ea5664e3947e775dca474ad53"} Jun 03 15:10:32.566698 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.566656 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" event={"ID":"ef39b6a6-df9c-49e6-8372-b434eaa93c8e","Type":"ContainerStarted","Data":"a0e9a0c96e91ae24187b7c085c98227cb68d37b5d4de8dd2220bc856fe2ac6ef"} Jun 03 15:10:32.566698 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.566685 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:32.567981 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.567957 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" event={"ID":"1832330e-cdf1-4a87-b204-32f6bbdfcbf6","Type":"ContainerStarted","Data":"0646cddaeb0ef324ff36dd83dc7c090af0044bd9a94ac34ae96102a27089b53e"} Jun 03 15:10:32.570074 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.570044 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" event={"ID":"168bc4db-eb89-44e5-9f7f-b03623997724","Type":"ContainerStarted","Data":"dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2"} Jun 03 15:10:32.570074 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.570075 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" event={"ID":"168bc4db-eb89-44e5-9f7f-b03623997724","Type":"ContainerStarted","Data":"4d92f916507a4bec2f53e7acc24ae2aeb930cfe22ee44e9f42d8659e4d769b14"} Jun 03 15:10:32.570246 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.570170 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:32.726473 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.726391 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" podStartSLOduration=14.726374735 podStartE2EDuration="14.726374735s" podCreationTimestamp="2026-06-03 15:10:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:10:32.62857212 +0000 UTC m=+416.951729433" watchObservedRunningTime="2026-06-03 15:10:32.726374735 +0000 UTC m=+417.049532039" Jun 03 15:10:32.821416 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.821362 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zsxkz" podStartSLOduration=1.422947325 podStartE2EDuration="25.821348916s" podCreationTimestamp="2026-06-03 15:10:07 +0000 UTC" firstStartedPulling="2026-06-03 15:10:07.611586569 +0000 UTC m=+391.934743850" lastFinishedPulling="2026-06-03 15:10:32.009988137 +0000 UTC m=+416.333145441" observedRunningTime="2026-06-03 15:10:32.815632598 +0000 UTC m=+417.138789905" watchObservedRunningTime="2026-06-03 15:10:32.821348916 +0000 UTC m=+417.144506216" Jun 03 15:10:32.822815 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:32.822779 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" podStartSLOduration=15.822767079 podStartE2EDuration="15.822767079s" podCreationTimestamp="2026-06-03 15:10:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:10:32.726904216 +0000 UTC m=+417.050061521" watchObservedRunningTime="2026-06-03 15:10:32.822767079 +0000 UTC m=+417.145924387" Jun 03 15:10:43.575652 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.575622 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:43.576067 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.575678 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-vkfq9" Jun 03 15:10:43.660109 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.660076 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf"] Jun 03 15:10:43.660344 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.660296 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" podUID="168bc4db-eb89-44e5-9f7f-b03623997724" containerName="manager" containerID="cri-o://dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2" gracePeriod=10 Jun 03 15:10:43.898053 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.898024 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:43.983195 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.983165 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr8pv\" (UniqueName: \"kubernetes.io/projected/168bc4db-eb89-44e5-9f7f-b03623997724-kube-api-access-lr8pv\") pod \"168bc4db-eb89-44e5-9f7f-b03623997724\" (UID: \"168bc4db-eb89-44e5-9f7f-b03623997724\") " Jun 03 15:10:43.983323 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.983211 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/168bc4db-eb89-44e5-9f7f-b03623997724-extensions-socket-volume\") pod \"168bc4db-eb89-44e5-9f7f-b03623997724\" (UID: \"168bc4db-eb89-44e5-9f7f-b03623997724\") " Jun 03 15:10:43.983650 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.983628 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/168bc4db-eb89-44e5-9f7f-b03623997724-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "168bc4db-eb89-44e5-9f7f-b03623997724" (UID: "168bc4db-eb89-44e5-9f7f-b03623997724"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 15:10:43.985410 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:43.985389 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/168bc4db-eb89-44e5-9f7f-b03623997724-kube-api-access-lr8pv" (OuterVolumeSpecName: "kube-api-access-lr8pv") pod "168bc4db-eb89-44e5-9f7f-b03623997724" (UID: "168bc4db-eb89-44e5-9f7f-b03623997724"). InnerVolumeSpecName "kube-api-access-lr8pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:10:44.083860 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.083824 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr8pv\" (UniqueName: \"kubernetes.io/projected/168bc4db-eb89-44e5-9f7f-b03623997724-kube-api-access-lr8pv\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:10:44.083860 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.083853 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/168bc4db-eb89-44e5-9f7f-b03623997724-extensions-socket-volume\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:10:44.606960 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.606917 2574 generic.go:358] "Generic (PLEG): container finished" podID="168bc4db-eb89-44e5-9f7f-b03623997724" containerID="dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2" exitCode=0 Jun 03 15:10:44.607475 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.607001 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" Jun 03 15:10:44.607475 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.607003 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" event={"ID":"168bc4db-eb89-44e5-9f7f-b03623997724","Type":"ContainerDied","Data":"dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2"} Jun 03 15:10:44.607475 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.607052 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf" event={"ID":"168bc4db-eb89-44e5-9f7f-b03623997724","Type":"ContainerDied","Data":"4d92f916507a4bec2f53e7acc24ae2aeb930cfe22ee44e9f42d8659e4d769b14"} Jun 03 15:10:44.607475 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.607077 2574 scope.go:117] "RemoveContainer" containerID="dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2" Jun 03 15:10:44.614848 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.614831 2574 scope.go:117] "RemoveContainer" containerID="dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2" Jun 03 15:10:44.615096 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:10:44.615075 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2\": container with ID starting with dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2 not found: ID does not exist" containerID="dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2" Jun 03 15:10:44.615148 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.615103 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2"} err="failed to get container status \"dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2\": rpc error: code = NotFound desc = could not find container \"dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2\": container with ID starting with dd2b1c144da2e12257fca112dd652e28b547213a16e6df110301263089d71ff2 not found: ID does not exist" Jun 03 15:10:44.671200 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.671163 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf"] Jun 03 15:10:44.680146 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:44.680116 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-8pvrf"] Jun 03 15:10:46.209201 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:10:46.209167 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="168bc4db-eb89-44e5-9f7f-b03623997724" path="/var/lib/kubelet/pods/168bc4db-eb89-44e5-9f7f-b03623997724/volumes" Jun 03 15:11:05.404463 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.404410 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nhljc"] Jun 03 15:11:05.404949 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.404923 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="168bc4db-eb89-44e5-9f7f-b03623997724" containerName="manager" Jun 03 15:11:05.404949 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.404942 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="168bc4db-eb89-44e5-9f7f-b03623997724" containerName="manager" Jun 03 15:11:05.405064 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.405014 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="168bc4db-eb89-44e5-9f7f-b03623997724" containerName="manager" Jun 03 15:11:05.425494 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.425462 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:05.428472 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.428426 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nhljc"] Jun 03 15:11:05.434910 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.434893 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 03 15:11:05.523353 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.523321 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nhljc"] Jun 03 15:11:05.561744 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.561709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60144575-7980-4965-a77b-2801b16a62d6-config-file\") pod \"limitador-limitador-7d549b5b-nhljc\" (UID: \"60144575-7980-4965-a77b-2801b16a62d6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:05.561900 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.561758 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm7s7\" (UniqueName: \"kubernetes.io/projected/60144575-7980-4965-a77b-2801b16a62d6-kube-api-access-vm7s7\") pod \"limitador-limitador-7d549b5b-nhljc\" (UID: \"60144575-7980-4965-a77b-2801b16a62d6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:05.662856 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.662759 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60144575-7980-4965-a77b-2801b16a62d6-config-file\") pod \"limitador-limitador-7d549b5b-nhljc\" (UID: \"60144575-7980-4965-a77b-2801b16a62d6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:05.662856 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.662821 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vm7s7\" (UniqueName: \"kubernetes.io/projected/60144575-7980-4965-a77b-2801b16a62d6-kube-api-access-vm7s7\") pod \"limitador-limitador-7d549b5b-nhljc\" (UID: \"60144575-7980-4965-a77b-2801b16a62d6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:05.663484 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.663431 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60144575-7980-4965-a77b-2801b16a62d6-config-file\") pod \"limitador-limitador-7d549b5b-nhljc\" (UID: \"60144575-7980-4965-a77b-2801b16a62d6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:05.685379 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.685351 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm7s7\" (UniqueName: \"kubernetes.io/projected/60144575-7980-4965-a77b-2801b16a62d6-kube-api-access-vm7s7\") pod \"limitador-limitador-7d549b5b-nhljc\" (UID: \"60144575-7980-4965-a77b-2801b16a62d6\") " pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:05.736381 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.736343 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:05.884756 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:11:05.884723 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60144575_7980_4965_a77b_2801b16a62d6.slice/crio-5dbe45133c9cef119e254405b91ffd5714b93965cb2d6acf953afe11d4f268aa WatchSource:0}: Error finding container 5dbe45133c9cef119e254405b91ffd5714b93965cb2d6acf953afe11d4f268aa: Status 404 returned error can't find the container with id 5dbe45133c9cef119e254405b91ffd5714b93965cb2d6acf953afe11d4f268aa Jun 03 15:11:05.884947 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:05.884921 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nhljc"] Jun 03 15:11:06.556779 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.556746 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qrdg8"] Jun 03 15:11:06.560114 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.560094 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" Jun 03 15:11:06.564917 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.564896 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b7zbc\"" Jun 03 15:11:06.582331 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.582304 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qrdg8"] Jun 03 15:11:06.670739 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.670698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsztt\" (UniqueName: \"kubernetes.io/projected/5b692529-fc5d-4497-816d-cbc02c75a79a-kube-api-access-lsztt\") pod \"authorino-f99f4b5cd-qrdg8\" (UID: \"5b692529-fc5d-4497-816d-cbc02c75a79a\") " pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" Jun 03 15:11:06.679662 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.679624 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" event={"ID":"60144575-7980-4965-a77b-2801b16a62d6","Type":"ContainerStarted","Data":"5dbe45133c9cef119e254405b91ffd5714b93965cb2d6acf953afe11d4f268aa"} Jun 03 15:11:06.771718 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.771678 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lsztt\" (UniqueName: \"kubernetes.io/projected/5b692529-fc5d-4497-816d-cbc02c75a79a-kube-api-access-lsztt\") pod \"authorino-f99f4b5cd-qrdg8\" (UID: \"5b692529-fc5d-4497-816d-cbc02c75a79a\") " pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" Jun 03 15:11:06.788145 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.788112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsztt\" (UniqueName: \"kubernetes.io/projected/5b692529-fc5d-4497-816d-cbc02c75a79a-kube-api-access-lsztt\") pod \"authorino-f99f4b5cd-qrdg8\" (UID: \"5b692529-fc5d-4497-816d-cbc02c75a79a\") " pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" Jun 03 15:11:06.871055 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.871021 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" Jun 03 15:11:06.887142 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.885667 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-g2mc8"] Jun 03 15:11:06.889594 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.889569 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-g2mc8" Jun 03 15:11:06.902846 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.902395 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-g2mc8"] Jun 03 15:11:06.973741 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:06.973614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tzpx\" (UniqueName: \"kubernetes.io/projected/f204ed49-149a-41d5-bf57-496144aec753-kube-api-access-2tzpx\") pod \"authorino-7498df8756-g2mc8\" (UID: \"f204ed49-149a-41d5-bf57-496144aec753\") " pod="kuadrant-system/authorino-7498df8756-g2mc8" Jun 03 15:11:07.041879 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:07.041821 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qrdg8"] Jun 03 15:11:07.042659 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:11:07.042633 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b692529_fc5d_4497_816d_cbc02c75a79a.slice/crio-958baf9dab33b175cda15d987c068cded737fbc9d3bc085d06bd05ffe2b4a5f8 WatchSource:0}: Error finding container 958baf9dab33b175cda15d987c068cded737fbc9d3bc085d06bd05ffe2b4a5f8: Status 404 returned error can't find the container with id 958baf9dab33b175cda15d987c068cded737fbc9d3bc085d06bd05ffe2b4a5f8 Jun 03 15:11:07.074162 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:07.074123 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tzpx\" (UniqueName: \"kubernetes.io/projected/f204ed49-149a-41d5-bf57-496144aec753-kube-api-access-2tzpx\") pod \"authorino-7498df8756-g2mc8\" (UID: \"f204ed49-149a-41d5-bf57-496144aec753\") " pod="kuadrant-system/authorino-7498df8756-g2mc8" Jun 03 15:11:07.102836 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:07.102807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tzpx\" (UniqueName: \"kubernetes.io/projected/f204ed49-149a-41d5-bf57-496144aec753-kube-api-access-2tzpx\") pod \"authorino-7498df8756-g2mc8\" (UID: \"f204ed49-149a-41d5-bf57-496144aec753\") " pod="kuadrant-system/authorino-7498df8756-g2mc8" Jun 03 15:11:07.207173 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:07.207041 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-g2mc8" Jun 03 15:11:07.374396 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:07.374364 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-g2mc8"] Jun 03 15:11:07.684090 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:07.684052 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" event={"ID":"5b692529-fc5d-4497-816d-cbc02c75a79a","Type":"ContainerStarted","Data":"958baf9dab33b175cda15d987c068cded737fbc9d3bc085d06bd05ffe2b4a5f8"} Jun 03 15:11:07.913412 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:11:07.913378 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf204ed49_149a_41d5_bf57_496144aec753.slice/crio-f41033dc0b301fb114d90a7c802222936fa05634878c571542bbb052613fc717 WatchSource:0}: Error finding container f41033dc0b301fb114d90a7c802222936fa05634878c571542bbb052613fc717: Status 404 returned error can't find the container with id f41033dc0b301fb114d90a7c802222936fa05634878c571542bbb052613fc717 Jun 03 15:11:08.690427 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:08.690382 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-g2mc8" event={"ID":"f204ed49-149a-41d5-bf57-496144aec753","Type":"ContainerStarted","Data":"f41033dc0b301fb114d90a7c802222936fa05634878c571542bbb052613fc717"} Jun 03 15:11:09.696048 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:09.695996 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" event={"ID":"60144575-7980-4965-a77b-2801b16a62d6","Type":"ContainerStarted","Data":"fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d"} Jun 03 15:11:09.696543 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:09.696135 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:12.706899 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:12.706853 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-g2mc8" event={"ID":"f204ed49-149a-41d5-bf57-496144aec753","Type":"ContainerStarted","Data":"0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6"} Jun 03 15:11:12.708064 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:12.708041 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" event={"ID":"5b692529-fc5d-4497-816d-cbc02c75a79a","Type":"ContainerStarted","Data":"6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746"} Jun 03 15:11:12.734061 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:12.734013 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-g2mc8" podStartSLOduration=2.636270261 podStartE2EDuration="6.733999387s" podCreationTimestamp="2026-06-03 15:11:06 +0000 UTC" firstStartedPulling="2026-06-03 15:11:07.914630986 +0000 UTC m=+452.237788267" lastFinishedPulling="2026-06-03 15:11:12.012360111 +0000 UTC m=+456.335517393" observedRunningTime="2026-06-03 15:11:12.72716215 +0000 UTC m=+457.050319452" watchObservedRunningTime="2026-06-03 15:11:12.733999387 +0000 UTC m=+457.057156689" Jun 03 15:11:12.734303 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:12.734284 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" podStartSLOduration=4.857971925 podStartE2EDuration="7.734278646s" podCreationTimestamp="2026-06-03 15:11:05 +0000 UTC" firstStartedPulling="2026-06-03 15:11:05.886783161 +0000 UTC m=+450.209940442" lastFinishedPulling="2026-06-03 15:11:08.763089854 +0000 UTC m=+453.086247163" observedRunningTime="2026-06-03 15:11:09.746937505 +0000 UTC m=+454.070094809" watchObservedRunningTime="2026-06-03 15:11:12.734278646 +0000 UTC m=+457.057435951" Jun 03 15:11:12.752264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:12.752207 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" podStartSLOduration=1.7941315389999999 podStartE2EDuration="6.752193704s" podCreationTimestamp="2026-06-03 15:11:06 +0000 UTC" firstStartedPulling="2026-06-03 15:11:07.044293479 +0000 UTC m=+451.367450774" lastFinishedPulling="2026-06-03 15:11:12.002355655 +0000 UTC m=+456.325512939" observedRunningTime="2026-06-03 15:11:12.750000918 +0000 UTC m=+457.073158222" watchObservedRunningTime="2026-06-03 15:11:12.752193704 +0000 UTC m=+457.075351007" Jun 03 15:11:12.807842 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:12.807810 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qrdg8"] Jun 03 15:11:14.713457 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:14.713395 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" podUID="5b692529-fc5d-4497-816d-cbc02c75a79a" containerName="authorino" containerID="cri-o://6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746" gracePeriod=30 Jun 03 15:11:14.950831 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:14.950803 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" Jun 03 15:11:15.045790 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.045700 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsztt\" (UniqueName: \"kubernetes.io/projected/5b692529-fc5d-4497-816d-cbc02c75a79a-kube-api-access-lsztt\") pod \"5b692529-fc5d-4497-816d-cbc02c75a79a\" (UID: \"5b692529-fc5d-4497-816d-cbc02c75a79a\") " Jun 03 15:11:15.047901 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.047875 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b692529-fc5d-4497-816d-cbc02c75a79a-kube-api-access-lsztt" (OuterVolumeSpecName: "kube-api-access-lsztt") pod "5b692529-fc5d-4497-816d-cbc02c75a79a" (UID: "5b692529-fc5d-4497-816d-cbc02c75a79a"). InnerVolumeSpecName "kube-api-access-lsztt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:11:15.146425 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.146395 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsztt\" (UniqueName: \"kubernetes.io/projected/5b692529-fc5d-4497-816d-cbc02c75a79a-kube-api-access-lsztt\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:11:15.717768 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.717732 2574 generic.go:358] "Generic (PLEG): container finished" podID="5b692529-fc5d-4497-816d-cbc02c75a79a" containerID="6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746" exitCode=0 Jun 03 15:11:15.718209 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.717779 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" Jun 03 15:11:15.718209 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.717819 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" event={"ID":"5b692529-fc5d-4497-816d-cbc02c75a79a","Type":"ContainerDied","Data":"6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746"} Jun 03 15:11:15.718209 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.717851 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-qrdg8" event={"ID":"5b692529-fc5d-4497-816d-cbc02c75a79a","Type":"ContainerDied","Data":"958baf9dab33b175cda15d987c068cded737fbc9d3bc085d06bd05ffe2b4a5f8"} Jun 03 15:11:15.718209 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.717866 2574 scope.go:117] "RemoveContainer" containerID="6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746" Jun 03 15:11:15.726206 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.726189 2574 scope.go:117] "RemoveContainer" containerID="6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746" Jun 03 15:11:15.726466 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:11:15.726425 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746\": container with ID starting with 6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746 not found: ID does not exist" containerID="6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746" Jun 03 15:11:15.726546 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.726471 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746"} err="failed to get container status \"6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746\": rpc error: code = NotFound desc = could not find container \"6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746\": container with ID starting with 6a24634e2ffea0db858c075e1856de7d44261ea367b178ba3980bcd0663e7746 not found: ID does not exist" Jun 03 15:11:15.749226 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.749196 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qrdg8"] Jun 03 15:11:15.764685 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:15.764658 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-qrdg8"] Jun 03 15:11:16.207909 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:16.207866 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b692529-fc5d-4497-816d-cbc02c75a79a" path="/var/lib/kubelet/pods/5b692529-fc5d-4497-816d-cbc02c75a79a/volumes" Jun 03 15:11:20.490543 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:20.490507 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nhljc"] Jun 03 15:11:20.491014 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:20.490810 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" podUID="60144575-7980-4965-a77b-2801b16a62d6" containerName="limitador" containerID="cri-o://fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d" gracePeriod=30 Jun 03 15:11:20.491516 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:20.491412 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:21.039188 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.039161 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:21.199412 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.199376 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm7s7\" (UniqueName: \"kubernetes.io/projected/60144575-7980-4965-a77b-2801b16a62d6-kube-api-access-vm7s7\") pod \"60144575-7980-4965-a77b-2801b16a62d6\" (UID: \"60144575-7980-4965-a77b-2801b16a62d6\") " Jun 03 15:11:21.199612 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.199489 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60144575-7980-4965-a77b-2801b16a62d6-config-file\") pod \"60144575-7980-4965-a77b-2801b16a62d6\" (UID: \"60144575-7980-4965-a77b-2801b16a62d6\") " Jun 03 15:11:21.199875 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.199846 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60144575-7980-4965-a77b-2801b16a62d6-config-file" (OuterVolumeSpecName: "config-file") pod "60144575-7980-4965-a77b-2801b16a62d6" (UID: "60144575-7980-4965-a77b-2801b16a62d6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 15:11:21.201550 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.201522 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60144575-7980-4965-a77b-2801b16a62d6-kube-api-access-vm7s7" (OuterVolumeSpecName: "kube-api-access-vm7s7") pod "60144575-7980-4965-a77b-2801b16a62d6" (UID: "60144575-7980-4965-a77b-2801b16a62d6"). InnerVolumeSpecName "kube-api-access-vm7s7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:11:21.300373 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.300336 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm7s7\" (UniqueName: \"kubernetes.io/projected/60144575-7980-4965-a77b-2801b16a62d6-kube-api-access-vm7s7\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:11:21.300373 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.300367 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/60144575-7980-4965-a77b-2801b16a62d6-config-file\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:11:21.738128 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.738090 2574 generic.go:358] "Generic (PLEG): container finished" podID="60144575-7980-4965-a77b-2801b16a62d6" containerID="fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d" exitCode=0 Jun 03 15:11:21.738562 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.738160 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" Jun 03 15:11:21.738562 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.738170 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" event={"ID":"60144575-7980-4965-a77b-2801b16a62d6","Type":"ContainerDied","Data":"fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d"} Jun 03 15:11:21.738562 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.738208 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7d549b5b-nhljc" event={"ID":"60144575-7980-4965-a77b-2801b16a62d6","Type":"ContainerDied","Data":"5dbe45133c9cef119e254405b91ffd5714b93965cb2d6acf953afe11d4f268aa"} Jun 03 15:11:21.738562 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.738224 2574 scope.go:117] "RemoveContainer" containerID="fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d" Jun 03 15:11:21.746676 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.746657 2574 scope.go:117] "RemoveContainer" containerID="fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d" Jun 03 15:11:21.746951 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:11:21.746933 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d\": container with ID starting with fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d not found: ID does not exist" containerID="fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d" Jun 03 15:11:21.747023 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.746959 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d"} err="failed to get container status \"fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d\": rpc error: code = NotFound desc = could not find container \"fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d\": container with ID starting with fed4a6ce17a665c038a850f6e1380a423e01597d4febd5f2e1ebc8e717fcae3d not found: ID does not exist" Jun 03 15:11:21.768942 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.768029 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nhljc"] Jun 03 15:11:21.771926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:21.771557 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-7d549b5b-nhljc"] Jun 03 15:11:22.207976 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:22.207938 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60144575-7980-4965-a77b-2801b16a62d6" path="/var/lib/kubelet/pods/60144575-7980-4965-a77b-2801b16a62d6/volumes" Jun 03 15:11:26.402906 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.402872 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-68c4fbbd6f-txpcx"] Jun 03 15:11:26.403327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.403175 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60144575-7980-4965-a77b-2801b16a62d6" containerName="limitador" Jun 03 15:11:26.403327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.403188 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="60144575-7980-4965-a77b-2801b16a62d6" containerName="limitador" Jun 03 15:11:26.403327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.403197 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b692529-fc5d-4497-816d-cbc02c75a79a" containerName="authorino" Jun 03 15:11:26.403327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.403202 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b692529-fc5d-4497-816d-cbc02c75a79a" containerName="authorino" Jun 03 15:11:26.403327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.403259 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="5b692529-fc5d-4497-816d-cbc02c75a79a" containerName="authorino" Jun 03 15:11:26.403327 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.403267 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="60144575-7980-4965-a77b-2801b16a62d6" containerName="limitador" Jun 03 15:11:26.405821 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.405761 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:26.409049 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.409029 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rtrn8\"" Jun 03 15:11:26.409049 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.409053 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 03 15:11:26.418492 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.418472 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-txpcx"] Jun 03 15:11:26.548351 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.548318 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20c61016-582d-415f-9760-991e02c4660f-data\") pod \"postgres-68c4fbbd6f-txpcx\" (UID: \"20c61016-582d-415f-9760-991e02c4660f\") " pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:26.548569 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.548368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmx8r\" (UniqueName: \"kubernetes.io/projected/20c61016-582d-415f-9760-991e02c4660f-kube-api-access-xmx8r\") pod \"postgres-68c4fbbd6f-txpcx\" (UID: \"20c61016-582d-415f-9760-991e02c4660f\") " pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:26.649611 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.649578 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmx8r\" (UniqueName: \"kubernetes.io/projected/20c61016-582d-415f-9760-991e02c4660f-kube-api-access-xmx8r\") pod \"postgres-68c4fbbd6f-txpcx\" (UID: \"20c61016-582d-415f-9760-991e02c4660f\") " pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:26.649789 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.649656 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20c61016-582d-415f-9760-991e02c4660f-data\") pod \"postgres-68c4fbbd6f-txpcx\" (UID: \"20c61016-582d-415f-9760-991e02c4660f\") " pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:26.649995 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.649978 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/20c61016-582d-415f-9760-991e02c4660f-data\") pod \"postgres-68c4fbbd6f-txpcx\" (UID: \"20c61016-582d-415f-9760-991e02c4660f\") " pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:26.660867 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.660807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmx8r\" (UniqueName: \"kubernetes.io/projected/20c61016-582d-415f-9760-991e02c4660f-kube-api-access-xmx8r\") pod \"postgres-68c4fbbd6f-txpcx\" (UID: \"20c61016-582d-415f-9760-991e02c4660f\") " pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:26.718669 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.718628 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:26.853844 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:26.853821 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-68c4fbbd6f-txpcx"] Jun 03 15:11:26.855992 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:11:26.855966 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c61016_582d_415f_9760_991e02c4660f.slice/crio-588d2bdbe48fd467868bdfc5824c64e43266360035847845a4996b2e19309194 WatchSource:0}: Error finding container 588d2bdbe48fd467868bdfc5824c64e43266360035847845a4996b2e19309194: Status 404 returned error can't find the container with id 588d2bdbe48fd467868bdfc5824c64e43266360035847845a4996b2e19309194 Jun 03 15:11:27.760335 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:27.760299 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-txpcx" event={"ID":"20c61016-582d-415f-9760-991e02c4660f","Type":"ContainerStarted","Data":"588d2bdbe48fd467868bdfc5824c64e43266360035847845a4996b2e19309194"} Jun 03 15:11:31.776877 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:31.776776 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-68c4fbbd6f-txpcx" event={"ID":"20c61016-582d-415f-9760-991e02c4660f","Type":"ContainerStarted","Data":"f048598e0ae888cbb82f5d1d2ca8beef775852416e4bc0f2f69edcf959d81da1"} Jun 03 15:11:31.776877 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:31.776824 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:37.809600 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:37.809571 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-68c4fbbd6f-txpcx" Jun 03 15:11:37.830393 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:11:37.830346 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/postgres-68c4fbbd6f-txpcx" podStartSLOduration=7.229255198 podStartE2EDuration="11.83033225s" podCreationTimestamp="2026-06-03 15:11:26 +0000 UTC" firstStartedPulling="2026-06-03 15:11:26.857526659 +0000 UTC m=+471.180683939" lastFinishedPulling="2026-06-03 15:11:31.458603709 +0000 UTC m=+475.781760991" observedRunningTime="2026-06-03 15:11:31.81591246 +0000 UTC m=+476.139069774" watchObservedRunningTime="2026-06-03 15:11:37.83033225 +0000 UTC m=+482.153489553" Jun 03 15:12:34.953090 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:34.953052 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dmwqn"] Jun 03 15:12:34.956551 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:34.956529 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" Jun 03 15:12:34.962725 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:34.962703 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dmwqn"] Jun 03 15:12:35.008988 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.008956 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpkrc\" (UniqueName: \"kubernetes.io/projected/dd45b402-9535-4c0a-8e8d-1816c86fddf9-kube-api-access-rpkrc\") pod \"authorino-8b475cf9f-dmwqn\" (UID: \"dd45b402-9535-4c0a-8e8d-1816c86fddf9\") " pod="kuadrant-system/authorino-8b475cf9f-dmwqn" Jun 03 15:12:35.109514 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.109474 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpkrc\" (UniqueName: \"kubernetes.io/projected/dd45b402-9535-4c0a-8e8d-1816c86fddf9-kube-api-access-rpkrc\") pod \"authorino-8b475cf9f-dmwqn\" (UID: \"dd45b402-9535-4c0a-8e8d-1816c86fddf9\") " pod="kuadrant-system/authorino-8b475cf9f-dmwqn" Jun 03 15:12:35.120054 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.120031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpkrc\" (UniqueName: \"kubernetes.io/projected/dd45b402-9535-4c0a-8e8d-1816c86fddf9-kube-api-access-rpkrc\") pod \"authorino-8b475cf9f-dmwqn\" (UID: \"dd45b402-9535-4c0a-8e8d-1816c86fddf9\") " pod="kuadrant-system/authorino-8b475cf9f-dmwqn" Jun 03 15:12:35.152841 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.152798 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dmwqn"] Jun 03 15:12:35.153036 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.153025 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" Jun 03 15:12:35.179824 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.179791 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bb95d5678-npgfn"] Jun 03 15:12:35.185030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.184988 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:12:35.188438 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.188409 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 03 15:12:35.191094 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.191071 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bb95d5678-npgfn"] Jun 03 15:12:35.293264 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.293233 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dmwqn"] Jun 03 15:12:35.295697 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:12:35.295666 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd45b402_9535_4c0a_8e8d_1816c86fddf9.slice/crio-3c677bff47d084d3e310cb6b858412f272fb21d878823c0873d44cd601234465 WatchSource:0}: Error finding container 3c677bff47d084d3e310cb6b858412f272fb21d878823c0873d44cd601234465: Status 404 returned error can't find the container with id 3c677bff47d084d3e310cb6b858412f272fb21d878823c0873d44cd601234465 Jun 03 15:12:35.312063 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.311881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9ztp\" (UniqueName: \"kubernetes.io/projected/66aeb4c8-c340-4530-a5d4-4c6534727b56-kube-api-access-q9ztp\") pod \"authorino-6bb95d5678-npgfn\" (UID: \"66aeb4c8-c340-4530-a5d4-4c6534727b56\") " pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:12:35.312063 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.311979 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66aeb4c8-c340-4530-a5d4-4c6534727b56-tls-cert\") pod \"authorino-6bb95d5678-npgfn\" (UID: \"66aeb4c8-c340-4530-a5d4-4c6534727b56\") " pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:12:35.412883 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.412845 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q9ztp\" (UniqueName: \"kubernetes.io/projected/66aeb4c8-c340-4530-a5d4-4c6534727b56-kube-api-access-q9ztp\") pod \"authorino-6bb95d5678-npgfn\" (UID: \"66aeb4c8-c340-4530-a5d4-4c6534727b56\") " pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:12:35.413056 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.412911 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66aeb4c8-c340-4530-a5d4-4c6534727b56-tls-cert\") pod \"authorino-6bb95d5678-npgfn\" (UID: \"66aeb4c8-c340-4530-a5d4-4c6534727b56\") " pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:12:35.415353 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.415333 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66aeb4c8-c340-4530-a5d4-4c6534727b56-tls-cert\") pod \"authorino-6bb95d5678-npgfn\" (UID: \"66aeb4c8-c340-4530-a5d4-4c6534727b56\") " pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:12:35.423585 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.423562 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9ztp\" (UniqueName: \"kubernetes.io/projected/66aeb4c8-c340-4530-a5d4-4c6534727b56-kube-api-access-q9ztp\") pod \"authorino-6bb95d5678-npgfn\" (UID: \"66aeb4c8-c340-4530-a5d4-4c6534727b56\") " pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:12:35.498769 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.498682 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:12:35.621719 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.621683 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bb95d5678-npgfn"] Jun 03 15:12:35.627006 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:12:35.626976 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66aeb4c8_c340_4530_a5d4_4c6534727b56.slice/crio-93a749581d3ca22017ef8f1f740041c089be49a4b1afb6beca7b45ea4a2172c5 WatchSource:0}: Error finding container 93a749581d3ca22017ef8f1f740041c089be49a4b1afb6beca7b45ea4a2172c5: Status 404 returned error can't find the container with id 93a749581d3ca22017ef8f1f740041c089be49a4b1afb6beca7b45ea4a2172c5 Jun 03 15:12:35.988063 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.988031 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb95d5678-npgfn" event={"ID":"66aeb4c8-c340-4530-a5d4-4c6534727b56","Type":"ContainerStarted","Data":"93a749581d3ca22017ef8f1f740041c089be49a4b1afb6beca7b45ea4a2172c5"} Jun 03 15:12:35.989269 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.989243 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" event={"ID":"dd45b402-9535-4c0a-8e8d-1816c86fddf9","Type":"ContainerStarted","Data":"828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb"} Jun 03 15:12:35.989360 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.989273 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" event={"ID":"dd45b402-9535-4c0a-8e8d-1816c86fddf9","Type":"ContainerStarted","Data":"3c677bff47d084d3e310cb6b858412f272fb21d878823c0873d44cd601234465"} Jun 03 15:12:35.989360 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:35.989306 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" podUID="dd45b402-9535-4c0a-8e8d-1816c86fddf9" containerName="authorino" containerID="cri-o://828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb" gracePeriod=30 Jun 03 15:12:36.010491 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.010432 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" podStartSLOduration=1.678363544 podStartE2EDuration="2.010420423s" podCreationTimestamp="2026-06-03 15:12:34 +0000 UTC" firstStartedPulling="2026-06-03 15:12:35.296987205 +0000 UTC m=+539.620144486" lastFinishedPulling="2026-06-03 15:12:35.629044081 +0000 UTC m=+539.952201365" observedRunningTime="2026-06-03 15:12:36.00994428 +0000 UTC m=+540.333101583" watchObservedRunningTime="2026-06-03 15:12:36.010420423 +0000 UTC m=+540.333577782" Jun 03 15:12:36.237435 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.237413 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" Jun 03 15:12:36.319236 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.319208 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpkrc\" (UniqueName: \"kubernetes.io/projected/dd45b402-9535-4c0a-8e8d-1816c86fddf9-kube-api-access-rpkrc\") pod \"dd45b402-9535-4c0a-8e8d-1816c86fddf9\" (UID: \"dd45b402-9535-4c0a-8e8d-1816c86fddf9\") " Jun 03 15:12:36.321486 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.321461 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd45b402-9535-4c0a-8e8d-1816c86fddf9-kube-api-access-rpkrc" (OuterVolumeSpecName: "kube-api-access-rpkrc") pod "dd45b402-9535-4c0a-8e8d-1816c86fddf9" (UID: "dd45b402-9535-4c0a-8e8d-1816c86fddf9"). InnerVolumeSpecName "kube-api-access-rpkrc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:12:36.420633 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.420596 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpkrc\" (UniqueName: \"kubernetes.io/projected/dd45b402-9535-4c0a-8e8d-1816c86fddf9-kube-api-access-rpkrc\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:12:36.994042 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.994006 2574 generic.go:358] "Generic (PLEG): container finished" podID="dd45b402-9535-4c0a-8e8d-1816c86fddf9" containerID="828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb" exitCode=0 Jun 03 15:12:36.994555 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.994056 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" Jun 03 15:12:36.994555 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.994096 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" event={"ID":"dd45b402-9535-4c0a-8e8d-1816c86fddf9","Type":"ContainerDied","Data":"828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb"} Jun 03 15:12:36.994555 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.994132 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-dmwqn" event={"ID":"dd45b402-9535-4c0a-8e8d-1816c86fddf9","Type":"ContainerDied","Data":"3c677bff47d084d3e310cb6b858412f272fb21d878823c0873d44cd601234465"} Jun 03 15:12:36.994555 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.994151 2574 scope.go:117] "RemoveContainer" containerID="828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb" Jun 03 15:12:36.995564 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:36.995545 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb95d5678-npgfn" event={"ID":"66aeb4c8-c340-4530-a5d4-4c6534727b56","Type":"ContainerStarted","Data":"7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71"} Jun 03 15:12:37.002208 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.002189 2574 scope.go:117] "RemoveContainer" containerID="828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb" Jun 03 15:12:37.002479 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:12:37.002421 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb\": container with ID starting with 828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb not found: ID does not exist" containerID="828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb" Jun 03 15:12:37.002479 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.002466 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb"} err="failed to get container status \"828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb\": rpc error: code = NotFound desc = could not find container \"828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb\": container with ID starting with 828e07eb0260f8bdb5484c7a8e57d9a66426552043a6becc28f185598c55e0bb not found: ID does not exist" Jun 03 15:12:37.016818 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.016774 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6bb95d5678-npgfn" podStartSLOduration=1.6354630829999999 podStartE2EDuration="2.01676313s" podCreationTimestamp="2026-06-03 15:12:35 +0000 UTC" firstStartedPulling="2026-06-03 15:12:35.62831422 +0000 UTC m=+539.951471501" lastFinishedPulling="2026-06-03 15:12:36.009614267 +0000 UTC m=+540.332771548" observedRunningTime="2026-06-03 15:12:37.015615921 +0000 UTC m=+541.338773224" watchObservedRunningTime="2026-06-03 15:12:37.01676313 +0000 UTC m=+541.339920433" Jun 03 15:12:37.032781 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.032756 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dmwqn"] Jun 03 15:12:37.039354 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.039329 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-dmwqn"] Jun 03 15:12:37.043541 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.043519 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-g2mc8"] Jun 03 15:12:37.043761 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.043720 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-g2mc8" podUID="f204ed49-149a-41d5-bf57-496144aec753" containerName="authorino" containerID="cri-o://0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6" gracePeriod=30 Jun 03 15:12:37.275692 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.275669 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-g2mc8" Jun 03 15:12:37.327430 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.327394 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tzpx\" (UniqueName: \"kubernetes.io/projected/f204ed49-149a-41d5-bf57-496144aec753-kube-api-access-2tzpx\") pod \"f204ed49-149a-41d5-bf57-496144aec753\" (UID: \"f204ed49-149a-41d5-bf57-496144aec753\") " Jun 03 15:12:37.329602 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.329577 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f204ed49-149a-41d5-bf57-496144aec753-kube-api-access-2tzpx" (OuterVolumeSpecName: "kube-api-access-2tzpx") pod "f204ed49-149a-41d5-bf57-496144aec753" (UID: "f204ed49-149a-41d5-bf57-496144aec753"). InnerVolumeSpecName "kube-api-access-2tzpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:12:37.428175 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.428127 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tzpx\" (UniqueName: \"kubernetes.io/projected/f204ed49-149a-41d5-bf57-496144aec753-kube-api-access-2tzpx\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:12:37.999862 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.999827 2574 generic.go:358] "Generic (PLEG): container finished" podID="f204ed49-149a-41d5-bf57-496144aec753" containerID="0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6" exitCode=0 Jun 03 15:12:38.000339 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.999906 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-g2mc8" Jun 03 15:12:38.000339 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.999908 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-g2mc8" event={"ID":"f204ed49-149a-41d5-bf57-496144aec753","Type":"ContainerDied","Data":"0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6"} Jun 03 15:12:38.000339 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.999953 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-g2mc8" event={"ID":"f204ed49-149a-41d5-bf57-496144aec753","Type":"ContainerDied","Data":"f41033dc0b301fb114d90a7c802222936fa05634878c571542bbb052613fc717"} Jun 03 15:12:38.000339 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:37.999971 2574 scope.go:117] "RemoveContainer" containerID="0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6" Jun 03 15:12:38.008416 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:38.008398 2574 scope.go:117] "RemoveContainer" containerID="0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6" Jun 03 15:12:38.008721 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:12:38.008701 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6\": container with ID starting with 0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6 not found: ID does not exist" containerID="0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6" Jun 03 15:12:38.008791 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:38.008728 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6"} err="failed to get container status \"0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6\": rpc error: code = NotFound desc = could not find container \"0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6\": container with ID starting with 0895153f0401842799f97f043ec2d44dc0c13f53ddc79d312b022e29f45907d6 not found: ID does not exist" Jun 03 15:12:38.024727 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:38.024703 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-g2mc8"] Jun 03 15:12:38.030530 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:38.030507 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-g2mc8"] Jun 03 15:12:38.208843 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:38.208814 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd45b402-9535-4c0a-8e8d-1816c86fddf9" path="/var/lib/kubelet/pods/dd45b402-9535-4c0a-8e8d-1816c86fddf9/volumes" Jun 03 15:12:38.209119 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:38.209107 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f204ed49-149a-41d5-bf57-496144aec753" path="/var/lib/kubelet/pods/f204ed49-149a-41d5-bf57-496144aec753/volumes" Jun 03 15:12:40.167249 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.167204 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5555b54947-4h442"] Jun 03 15:12:40.167788 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.167696 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd45b402-9535-4c0a-8e8d-1816c86fddf9" containerName="authorino" Jun 03 15:12:40.167788 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.167717 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd45b402-9535-4c0a-8e8d-1816c86fddf9" containerName="authorino" Jun 03 15:12:40.167788 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.167740 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f204ed49-149a-41d5-bf57-496144aec753" containerName="authorino" Jun 03 15:12:40.167788 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.167748 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f204ed49-149a-41d5-bf57-496144aec753" containerName="authorino" Jun 03 15:12:40.167979 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.167814 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="f204ed49-149a-41d5-bf57-496144aec753" containerName="authorino" Jun 03 15:12:40.167979 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.167828 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="dd45b402-9535-4c0a-8e8d-1816c86fddf9" containerName="authorino" Jun 03 15:12:40.172015 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.171992 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:40.175309 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.175283 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9bjhk\"" Jun 03 15:12:40.175475 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.175354 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 15:12:40.181677 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.181650 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5555b54947-4h442"] Jun 03 15:12:40.252692 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.252659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqthf\" (UniqueName: \"kubernetes.io/projected/ddfba654-3a8e-41bf-99f3-cf9fa62f044e-kube-api-access-lqthf\") pod \"maas-controller-5555b54947-4h442\" (UID: \"ddfba654-3a8e-41bf-99f3-cf9fa62f044e\") " pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:40.332191 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.332158 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6766ccdb5b-72r82"] Jun 03 15:12:40.335783 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.335756 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6766ccdb5b-72r82" Jun 03 15:12:40.351845 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.351823 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6766ccdb5b-72r82"] Jun 03 15:12:40.353678 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.353656 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lqthf\" (UniqueName: \"kubernetes.io/projected/ddfba654-3a8e-41bf-99f3-cf9fa62f044e-kube-api-access-lqthf\") pod \"maas-controller-5555b54947-4h442\" (UID: \"ddfba654-3a8e-41bf-99f3-cf9fa62f044e\") " pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:40.367483 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.367459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqthf\" (UniqueName: \"kubernetes.io/projected/ddfba654-3a8e-41bf-99f3-cf9fa62f044e-kube-api-access-lqthf\") pod \"maas-controller-5555b54947-4h442\" (UID: \"ddfba654-3a8e-41bf-99f3-cf9fa62f044e\") " pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:40.454968 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.454860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84z72\" (UniqueName: \"kubernetes.io/projected/75e4bbcd-7fb2-445c-98d5-ed39ead85500-kube-api-access-84z72\") pod \"maas-controller-6766ccdb5b-72r82\" (UID: \"75e4bbcd-7fb2-445c-98d5-ed39ead85500\") " pod="opendatahub/maas-controller-6766ccdb5b-72r82" Jun 03 15:12:40.483253 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.483222 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:40.555841 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.555811 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-84z72\" (UniqueName: \"kubernetes.io/projected/75e4bbcd-7fb2-445c-98d5-ed39ead85500-kube-api-access-84z72\") pod \"maas-controller-6766ccdb5b-72r82\" (UID: \"75e4bbcd-7fb2-445c-98d5-ed39ead85500\") " pod="opendatahub/maas-controller-6766ccdb5b-72r82" Jun 03 15:12:40.568561 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.568523 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84z72\" (UniqueName: \"kubernetes.io/projected/75e4bbcd-7fb2-445c-98d5-ed39ead85500-kube-api-access-84z72\") pod \"maas-controller-6766ccdb5b-72r82\" (UID: \"75e4bbcd-7fb2-445c-98d5-ed39ead85500\") " pod="opendatahub/maas-controller-6766ccdb5b-72r82" Jun 03 15:12:40.616140 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.616103 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5555b54947-4h442"] Jun 03 15:12:40.619234 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:12:40.619206 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfba654_3a8e_41bf_99f3_cf9fa62f044e.slice/crio-4f277d27cd2e930d47acc71859715aabdece195632adb477ae4c225ac6ebe415 WatchSource:0}: Error finding container 4f277d27cd2e930d47acc71859715aabdece195632adb477ae4c225ac6ebe415: Status 404 returned error can't find the container with id 4f277d27cd2e930d47acc71859715aabdece195632adb477ae4c225ac6ebe415 Jun 03 15:12:40.644829 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.644770 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6766ccdb5b-72r82" Jun 03 15:12:40.777744 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:40.777722 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6766ccdb5b-72r82"] Jun 03 15:12:40.778651 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:12:40.778629 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75e4bbcd_7fb2_445c_98d5_ed39ead85500.slice/crio-ba16d498575b63fc029e3938f9ae36ae20de99ae177a95c593a2777431f9c4aa WatchSource:0}: Error finding container ba16d498575b63fc029e3938f9ae36ae20de99ae177a95c593a2777431f9c4aa: Status 404 returned error can't find the container with id ba16d498575b63fc029e3938f9ae36ae20de99ae177a95c593a2777431f9c4aa Jun 03 15:12:41.016854 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:41.016766 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5555b54947-4h442" event={"ID":"ddfba654-3a8e-41bf-99f3-cf9fa62f044e","Type":"ContainerStarted","Data":"4f277d27cd2e930d47acc71859715aabdece195632adb477ae4c225ac6ebe415"} Jun 03 15:12:41.017725 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:41.017704 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6766ccdb5b-72r82" event={"ID":"75e4bbcd-7fb2-445c-98d5-ed39ead85500","Type":"ContainerStarted","Data":"ba16d498575b63fc029e3938f9ae36ae20de99ae177a95c593a2777431f9c4aa"} Jun 03 15:12:44.031351 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:44.031303 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5555b54947-4h442" event={"ID":"ddfba654-3a8e-41bf-99f3-cf9fa62f044e","Type":"ContainerStarted","Data":"d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e"} Jun 03 15:12:44.031839 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:44.031577 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:44.032670 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:44.032644 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6766ccdb5b-72r82" event={"ID":"75e4bbcd-7fb2-445c-98d5-ed39ead85500","Type":"ContainerStarted","Data":"9aca83347c20edd3caac7803ec37ba671cffbcf48ba8b2e1c54fbf8e17c0beb6"} Jun 03 15:12:44.032809 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:44.032799 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6766ccdb5b-72r82" Jun 03 15:12:44.051870 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:44.051814 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-5555b54947-4h442" podStartSLOduration=1.219395352 podStartE2EDuration="4.051797821s" podCreationTimestamp="2026-06-03 15:12:40 +0000 UTC" firstStartedPulling="2026-06-03 15:12:40.62087597 +0000 UTC m=+544.944033251" lastFinishedPulling="2026-06-03 15:12:43.453278438 +0000 UTC m=+547.776435720" observedRunningTime="2026-06-03 15:12:44.050481374 +0000 UTC m=+548.373638677" watchObservedRunningTime="2026-06-03 15:12:44.051797821 +0000 UTC m=+548.374955127" Jun 03 15:12:44.070394 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:44.070344 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-6766ccdb5b-72r82" podStartSLOduration=1.405883791 podStartE2EDuration="4.070317138s" podCreationTimestamp="2026-06-03 15:12:40 +0000 UTC" firstStartedPulling="2026-06-03 15:12:40.779928571 +0000 UTC m=+545.103085851" lastFinishedPulling="2026-06-03 15:12:43.444361918 +0000 UTC m=+547.767519198" observedRunningTime="2026-06-03 15:12:44.069966601 +0000 UTC m=+548.393123904" watchObservedRunningTime="2026-06-03 15:12:44.070317138 +0000 UTC m=+548.393474444" Jun 03 15:12:55.042332 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:55.042289 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6766ccdb5b-72r82" Jun 03 15:12:55.042768 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:55.042510 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:55.110237 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:55.110206 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5555b54947-4h442"] Jun 03 15:12:55.110497 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:55.110472 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-5555b54947-4h442" podUID="ddfba654-3a8e-41bf-99f3-cf9fa62f044e" containerName="manager" containerID="cri-o://d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e" gracePeriod=30 Jun 03 15:12:55.351975 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:55.351954 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:55.491194 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:55.491164 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqthf\" (UniqueName: \"kubernetes.io/projected/ddfba654-3a8e-41bf-99f3-cf9fa62f044e-kube-api-access-lqthf\") pod \"ddfba654-3a8e-41bf-99f3-cf9fa62f044e\" (UID: \"ddfba654-3a8e-41bf-99f3-cf9fa62f044e\") " Jun 03 15:12:55.493424 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:55.493397 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddfba654-3a8e-41bf-99f3-cf9fa62f044e-kube-api-access-lqthf" (OuterVolumeSpecName: "kube-api-access-lqthf") pod "ddfba654-3a8e-41bf-99f3-cf9fa62f044e" (UID: "ddfba654-3a8e-41bf-99f3-cf9fa62f044e"). InnerVolumeSpecName "kube-api-access-lqthf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:12:55.592325 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:55.592218 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqthf\" (UniqueName: \"kubernetes.io/projected/ddfba654-3a8e-41bf-99f3-cf9fa62f044e-kube-api-access-lqthf\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:12:56.070983 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.070950 2574 generic.go:358] "Generic (PLEG): container finished" podID="ddfba654-3a8e-41bf-99f3-cf9fa62f044e" containerID="d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e" exitCode=0 Jun 03 15:12:56.071423 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.071009 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5555b54947-4h442" Jun 03 15:12:56.071423 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.071035 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5555b54947-4h442" event={"ID":"ddfba654-3a8e-41bf-99f3-cf9fa62f044e","Type":"ContainerDied","Data":"d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e"} Jun 03 15:12:56.071423 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.071073 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5555b54947-4h442" event={"ID":"ddfba654-3a8e-41bf-99f3-cf9fa62f044e","Type":"ContainerDied","Data":"4f277d27cd2e930d47acc71859715aabdece195632adb477ae4c225ac6ebe415"} Jun 03 15:12:56.071423 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.071089 2574 scope.go:117] "RemoveContainer" containerID="d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e" Jun 03 15:12:56.081757 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.081731 2574 scope.go:117] "RemoveContainer" containerID="d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e" Jun 03 15:12:56.082057 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:12:56.082036 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e\": container with ID starting with d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e not found: ID does not exist" containerID="d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e" Jun 03 15:12:56.082108 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.082068 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e"} err="failed to get container status \"d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e\": rpc error: code = NotFound desc = could not find container \"d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e\": container with ID starting with d62d465e5d8b9be332bc0f54abdda180cad6bda3206f02b41fc1b321dd96b34e not found: ID does not exist" Jun 03 15:12:56.098730 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.098700 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5555b54947-4h442"] Jun 03 15:12:56.103912 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.103889 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5555b54947-4h442"] Jun 03 15:12:56.208310 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:12:56.208276 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddfba654-3a8e-41bf-99f3-cf9fa62f044e" path="/var/lib/kubelet/pods/ddfba654-3a8e-41bf-99f3-cf9fa62f044e/volumes" Jun 03 15:13:14.894590 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.894556 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-6848968976-srn7m"] Jun 03 15:13:14.895040 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.894859 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddfba654-3a8e-41bf-99f3-cf9fa62f044e" containerName="manager" Jun 03 15:13:14.895040 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.894871 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddfba654-3a8e-41bf-99f3-cf9fa62f044e" containerName="manager" Jun 03 15:13:14.895040 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.894921 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="ddfba654-3a8e-41bf-99f3-cf9fa62f044e" containerName="manager" Jun 03 15:13:14.901495 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.901473 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:14.904656 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.904637 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-wcpvc\"" Jun 03 15:13:14.906195 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.906176 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 15:13:14.912220 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.912195 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6848968976-srn7m"] Jun 03 15:13:14.942184 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.942157 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79529396-c5a3-4fa3-b341-330332c46a04-maas-api-tls\") pod \"maas-api-6848968976-srn7m\" (UID: \"79529396-c5a3-4fa3-b341-330332c46a04\") " pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:14.942330 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:14.942255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrlfv\" (UniqueName: \"kubernetes.io/projected/79529396-c5a3-4fa3-b341-330332c46a04-kube-api-access-mrlfv\") pod \"maas-api-6848968976-srn7m\" (UID: \"79529396-c5a3-4fa3-b341-330332c46a04\") " pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:15.043337 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.043304 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mrlfv\" (UniqueName: \"kubernetes.io/projected/79529396-c5a3-4fa3-b341-330332c46a04-kube-api-access-mrlfv\") pod \"maas-api-6848968976-srn7m\" (UID: \"79529396-c5a3-4fa3-b341-330332c46a04\") " pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:15.043548 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.043346 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79529396-c5a3-4fa3-b341-330332c46a04-maas-api-tls\") pod \"maas-api-6848968976-srn7m\" (UID: \"79529396-c5a3-4fa3-b341-330332c46a04\") " pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:15.046082 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.046058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/79529396-c5a3-4fa3-b341-330332c46a04-maas-api-tls\") pod \"maas-api-6848968976-srn7m\" (UID: \"79529396-c5a3-4fa3-b341-330332c46a04\") " pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:15.068373 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.068339 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrlfv\" (UniqueName: \"kubernetes.io/projected/79529396-c5a3-4fa3-b341-330332c46a04-kube-api-access-mrlfv\") pod \"maas-api-6848968976-srn7m\" (UID: \"79529396-c5a3-4fa3-b341-330332c46a04\") " pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:15.213115 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.213034 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:15.359558 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.359519 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vtptx"] Jun 03 15:13:15.361957 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:13:15.361927 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79529396_c5a3_4fa3_b341_330332c46a04.slice/crio-56efa686c0b374f089d6fc283474fe699f8dfcb66ead606abb84b41244cfb98f WatchSource:0}: Error finding container 56efa686c0b374f089d6fc283474fe699f8dfcb66ead606abb84b41244cfb98f: Status 404 returned error can't find the container with id 56efa686c0b374f089d6fc283474fe699f8dfcb66ead606abb84b41244cfb98f Jun 03 15:13:15.364396 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.364376 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-6848968976-srn7m"] Jun 03 15:13:15.364529 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.364517 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" Jun 03 15:13:15.368072 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.367881 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 15:13:15.368679 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.368657 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-c8rp5\"" Jun 03 15:13:15.373177 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.373157 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vtptx"] Jun 03 15:13:15.447081 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.447029 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwmt4\" (UniqueName: \"kubernetes.io/projected/eb8883a2-6891-468c-a92b-3be29ff87a14-kube-api-access-gwmt4\") pod \"payload-processing-58b6c8fdc7-vtptx\" (UID: \"eb8883a2-6891-468c-a92b-3be29ff87a14\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" Jun 03 15:13:15.547820 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.547723 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gwmt4\" (UniqueName: \"kubernetes.io/projected/eb8883a2-6891-468c-a92b-3be29ff87a14-kube-api-access-gwmt4\") pod \"payload-processing-58b6c8fdc7-vtptx\" (UID: \"eb8883a2-6891-468c-a92b-3be29ff87a14\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" Jun 03 15:13:15.557535 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.557500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwmt4\" (UniqueName: \"kubernetes.io/projected/eb8883a2-6891-468c-a92b-3be29ff87a14-kube-api-access-gwmt4\") pod \"payload-processing-58b6c8fdc7-vtptx\" (UID: \"eb8883a2-6891-468c-a92b-3be29ff87a14\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" Jun 03 15:13:15.680436 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.680403 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" Jun 03 15:13:15.812583 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:15.812513 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-vtptx"] Jun 03 15:13:15.815010 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:13:15.814986 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb8883a2_6891_468c_a92b_3be29ff87a14.slice/crio-f1d5b83713b21e2b226d51f838e80dcdbd0a780804b2761f14fdcbe8610bd0c9 WatchSource:0}: Error finding container f1d5b83713b21e2b226d51f838e80dcdbd0a780804b2761f14fdcbe8610bd0c9: Status 404 returned error can't find the container with id f1d5b83713b21e2b226d51f838e80dcdbd0a780804b2761f14fdcbe8610bd0c9 Jun 03 15:13:16.140540 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:16.140503 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" event={"ID":"eb8883a2-6891-468c-a92b-3be29ff87a14","Type":"ContainerStarted","Data":"f1d5b83713b21e2b226d51f838e80dcdbd0a780804b2761f14fdcbe8610bd0c9"} Jun 03 15:13:16.141738 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:16.141706 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6848968976-srn7m" event={"ID":"79529396-c5a3-4fa3-b341-330332c46a04","Type":"ContainerStarted","Data":"56efa686c0b374f089d6fc283474fe699f8dfcb66ead606abb84b41244cfb98f"} Jun 03 15:13:19.153625 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:19.153584 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" event={"ID":"eb8883a2-6891-468c-a92b-3be29ff87a14","Type":"ContainerStarted","Data":"312fc70e1db8bc313d384ab1ed67c6270c76d96be402c2461b950deced9d81f6"} Jun 03 15:13:19.154222 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:19.153836 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" Jun 03 15:13:19.155168 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:19.155142 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-6848968976-srn7m" event={"ID":"79529396-c5a3-4fa3-b341-330332c46a04","Type":"ContainerStarted","Data":"ec68d9e557e8e71c4ad68655772e72282cdeda58a24ce12761a96135a7185906"} Jun 03 15:13:19.155271 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:19.155248 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:19.173437 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:19.173383 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" podStartSLOduration=1.87454127 podStartE2EDuration="4.173365076s" podCreationTimestamp="2026-06-03 15:13:15 +0000 UTC" firstStartedPulling="2026-06-03 15:13:15.816765345 +0000 UTC m=+580.139922625" lastFinishedPulling="2026-06-03 15:13:18.11558915 +0000 UTC m=+582.438746431" observedRunningTime="2026-06-03 15:13:19.172285933 +0000 UTC m=+583.495443237" watchObservedRunningTime="2026-06-03 15:13:19.173365076 +0000 UTC m=+583.496522380" Jun 03 15:13:19.196286 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:19.196239 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-6848968976-srn7m" podStartSLOduration=2.490005118 podStartE2EDuration="5.1962253s" podCreationTimestamp="2026-06-03 15:13:14 +0000 UTC" firstStartedPulling="2026-06-03 15:13:15.36329353 +0000 UTC m=+579.686450811" lastFinishedPulling="2026-06-03 15:13:18.069513704 +0000 UTC m=+582.392670993" observedRunningTime="2026-06-03 15:13:19.194373314 +0000 UTC m=+583.517530617" watchObservedRunningTime="2026-06-03 15:13:19.1962253 +0000 UTC m=+583.519382603" Jun 03 15:13:25.170235 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:25.170202 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-6848968976-srn7m" Jun 03 15:13:30.166547 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:30.166512 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-vtptx" Jun 03 15:13:36.154739 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:36.154708 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:13:36.155190 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:13:36.154948 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:14:15.213229 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.213118 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d879b5774-hnckv"] Jun 03 15:14:15.220155 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.220130 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.224660 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.224634 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 03 15:14:15.226347 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.226324 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d879b5774-hnckv"] Jun 03 15:14:15.250646 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.250617 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/20a368fc-6583-4deb-9c28-411e18e8be8f-oidc-ca\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.250793 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.250675 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pv4c\" (UniqueName: \"kubernetes.io/projected/20a368fc-6583-4deb-9c28-411e18e8be8f-kube-api-access-4pv4c\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.250793 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.250728 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20a368fc-6583-4deb-9c28-411e18e8be8f-tls-cert\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.351626 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.351588 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/20a368fc-6583-4deb-9c28-411e18e8be8f-oidc-ca\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.351789 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.351657 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4pv4c\" (UniqueName: \"kubernetes.io/projected/20a368fc-6583-4deb-9c28-411e18e8be8f-kube-api-access-4pv4c\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.351789 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.351690 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20a368fc-6583-4deb-9c28-411e18e8be8f-tls-cert\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.352299 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.352269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/20a368fc-6583-4deb-9c28-411e18e8be8f-oidc-ca\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.354278 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.354249 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/20a368fc-6583-4deb-9c28-411e18e8be8f-tls-cert\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.361139 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.361116 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pv4c\" (UniqueName: \"kubernetes.io/projected/20a368fc-6583-4deb-9c28-411e18e8be8f-kube-api-access-4pv4c\") pod \"authorino-5d879b5774-hnckv\" (UID: \"20a368fc-6583-4deb-9c28-411e18e8be8f\") " pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.530102 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.530024 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d879b5774-hnckv" Jun 03 15:14:15.660030 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:15.660003 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d879b5774-hnckv"] Jun 03 15:14:15.662281 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:14:15.662254 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20a368fc_6583_4deb_9c28_411e18e8be8f.slice/crio-b161317bdbc530736229c3d1b63cd961f388a5df9de816a43814f5a4e9e942f5 WatchSource:0}: Error finding container b161317bdbc530736229c3d1b63cd961f388a5df9de816a43814f5a4e9e942f5: Status 404 returned error can't find the container with id b161317bdbc530736229c3d1b63cd961f388a5df9de816a43814f5a4e9e942f5 Jun 03 15:14:16.347089 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:16.347054 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d879b5774-hnckv" event={"ID":"20a368fc-6583-4deb-9c28-411e18e8be8f","Type":"ContainerStarted","Data":"b161317bdbc530736229c3d1b63cd961f388a5df9de816a43814f5a4e9e942f5"} Jun 03 15:14:17.352530 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.352495 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d879b5774-hnckv" event={"ID":"20a368fc-6583-4deb-9c28-411e18e8be8f","Type":"ContainerStarted","Data":"de2b6774d7f92eb9338a54194ce8586448d4214bb6ace952bfe4a1a2a1324f95"} Jun 03 15:14:17.372203 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.372153 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5d879b5774-hnckv" podStartSLOduration=1.737585289 podStartE2EDuration="2.372140574s" podCreationTimestamp="2026-06-03 15:14:15 +0000 UTC" firstStartedPulling="2026-06-03 15:14:15.663647199 +0000 UTC m=+639.986804480" lastFinishedPulling="2026-06-03 15:14:16.298202484 +0000 UTC m=+640.621359765" observedRunningTime="2026-06-03 15:14:17.371186622 +0000 UTC m=+641.694343925" watchObservedRunningTime="2026-06-03 15:14:17.372140574 +0000 UTC m=+641.695297921" Jun 03 15:14:17.401876 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.401841 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bb95d5678-npgfn"] Jun 03 15:14:17.402055 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.402037 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-6bb95d5678-npgfn" podUID="66aeb4c8-c340-4530-a5d4-4c6534727b56" containerName="authorino" containerID="cri-o://7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71" gracePeriod=30 Jun 03 15:14:17.449661 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:14:17.449621 2574 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66aeb4c8_c340_4530_a5d4_4c6534727b56.slice/crio-7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71.scope\": RecentStats: unable to find data in memory cache]" Jun 03 15:14:17.662560 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.662539 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:14:17.772762 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.772728 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66aeb4c8-c340-4530-a5d4-4c6534727b56-tls-cert\") pod \"66aeb4c8-c340-4530-a5d4-4c6534727b56\" (UID: \"66aeb4c8-c340-4530-a5d4-4c6534727b56\") " Jun 03 15:14:17.772930 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.772815 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9ztp\" (UniqueName: \"kubernetes.io/projected/66aeb4c8-c340-4530-a5d4-4c6534727b56-kube-api-access-q9ztp\") pod \"66aeb4c8-c340-4530-a5d4-4c6534727b56\" (UID: \"66aeb4c8-c340-4530-a5d4-4c6534727b56\") " Jun 03 15:14:17.774925 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.774897 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66aeb4c8-c340-4530-a5d4-4c6534727b56-kube-api-access-q9ztp" (OuterVolumeSpecName: "kube-api-access-q9ztp") pod "66aeb4c8-c340-4530-a5d4-4c6534727b56" (UID: "66aeb4c8-c340-4530-a5d4-4c6534727b56"). InnerVolumeSpecName "kube-api-access-q9ztp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 15:14:17.783024 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.782995 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66aeb4c8-c340-4530-a5d4-4c6534727b56-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "66aeb4c8-c340-4530-a5d4-4c6534727b56" (UID: "66aeb4c8-c340-4530-a5d4-4c6534727b56"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 15:14:17.873575 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.873542 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9ztp\" (UniqueName: \"kubernetes.io/projected/66aeb4c8-c340-4530-a5d4-4c6534727b56-kube-api-access-q9ztp\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:14:17.873575 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:17.873570 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/66aeb4c8-c340-4530-a5d4-4c6534727b56-tls-cert\") on node \"ip-10-0-133-0.ec2.internal\" DevicePath \"\"" Jun 03 15:14:18.356882 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.356847 2574 generic.go:358] "Generic (PLEG): container finished" podID="66aeb4c8-c340-4530-a5d4-4c6534727b56" containerID="7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71" exitCode=0 Jun 03 15:14:18.357336 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.356910 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb95d5678-npgfn" Jun 03 15:14:18.357336 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.356942 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb95d5678-npgfn" event={"ID":"66aeb4c8-c340-4530-a5d4-4c6534727b56","Type":"ContainerDied","Data":"7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71"} Jun 03 15:14:18.357336 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.356990 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb95d5678-npgfn" event={"ID":"66aeb4c8-c340-4530-a5d4-4c6534727b56","Type":"ContainerDied","Data":"93a749581d3ca22017ef8f1f740041c089be49a4b1afb6beca7b45ea4a2172c5"} Jun 03 15:14:18.357336 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.357013 2574 scope.go:117] "RemoveContainer" containerID="7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71" Jun 03 15:14:18.365504 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.365491 2574 scope.go:117] "RemoveContainer" containerID="7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71" Jun 03 15:14:18.365767 ip-10-0-133-0 kubenswrapper[2574]: E0603 15:14:18.365750 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71\": container with ID starting with 7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71 not found: ID does not exist" containerID="7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71" Jun 03 15:14:18.365826 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.365775 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71"} err="failed to get container status \"7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71\": rpc error: code = NotFound desc = could not find container \"7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71\": container with ID starting with 7c8a263a0f1fa5c63158115a3e42df1e75e9cee04a126e6698093de423cedd71 not found: ID does not exist" Jun 03 15:14:18.379995 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.379973 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bb95d5678-npgfn"] Jun 03 15:14:18.384258 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:18.384230 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bb95d5678-npgfn"] Jun 03 15:14:20.208715 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:14:20.208683 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66aeb4c8-c340-4530-a5d4-4c6534727b56" path="/var/lib/kubelet/pods/66aeb4c8-c340-4530-a5d4-4c6534727b56/volumes" Jun 03 15:15:03.492641 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.492603 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc"] Jun 03 15:15:03.493128 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.492926 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66aeb4c8-c340-4530-a5d4-4c6534727b56" containerName="authorino" Jun 03 15:15:03.493128 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.492938 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="66aeb4c8-c340-4530-a5d4-4c6534727b56" containerName="authorino" Jun 03 15:15:03.493128 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.492997 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="66aeb4c8-c340-4530-a5d4-4c6534727b56" containerName="authorino" Jun 03 15:15:03.496322 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.496289 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.501709 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.501683 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 15:15:03.502278 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.502244 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n8whh\"" Jun 03 15:15:03.502532 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.502513 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 03 15:15:03.502663 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.502643 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 15:15:03.509756 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.509731 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc"] Jun 03 15:15:03.553029 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.552995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flp2v\" (UniqueName: \"kubernetes.io/projected/57f33aa3-64ef-448c-afe8-e0b2e1331cda-kube-api-access-flp2v\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.553196 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.553064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57f33aa3-64ef-448c-afe8-e0b2e1331cda-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.553196 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.553093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.553196 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.553134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.553391 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.553216 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.553391 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.553261 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654210 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654178 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654210 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654216 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654440 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654249 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flp2v\" (UniqueName: \"kubernetes.io/projected/57f33aa3-64ef-448c-afe8-e0b2e1331cda-kube-api-access-flp2v\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654440 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654274 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57f33aa3-64ef-448c-afe8-e0b2e1331cda-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654440 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654289 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654440 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654314 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654677 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-home\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654677 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654646 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.654786 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.654765 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.656744 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.656690 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57f33aa3-64ef-448c-afe8-e0b2e1331cda-dshm\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.656906 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.656886 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57f33aa3-64ef-448c-afe8-e0b2e1331cda-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.662697 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.662674 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flp2v\" (UniqueName: \"kubernetes.io/projected/57f33aa3-64ef-448c-afe8-e0b2e1331cda-kube-api-access-flp2v\") pod \"e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc\" (UID: \"57f33aa3-64ef-448c-afe8-e0b2e1331cda\") " pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.810080 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.809994 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:03.944214 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.944175 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc"] Jun 03 15:15:03.946491 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:15:03.946434 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57f33aa3_64ef_448c_afe8_e0b2e1331cda.slice/crio-e4ac36413c133e0eb90159226f632f35e3fbbe5740580ece1453d9d27a3a0a5b WatchSource:0}: Error finding container e4ac36413c133e0eb90159226f632f35e3fbbe5740580ece1453d9d27a3a0a5b: Status 404 returned error can't find the container with id e4ac36413c133e0eb90159226f632f35e3fbbe5740580ece1453d9d27a3a0a5b Jun 03 15:15:03.948164 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:03.948146 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:15:04.510112 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:04.510074 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" event={"ID":"57f33aa3-64ef-448c-afe8-e0b2e1331cda","Type":"ContainerStarted","Data":"e4ac36413c133e0eb90159226f632f35e3fbbe5740580ece1453d9d27a3a0a5b"} Jun 03 15:15:07.522027 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:07.521986 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" event={"ID":"57f33aa3-64ef-448c-afe8-e0b2e1331cda","Type":"ContainerStarted","Data":"031396a0a317ee76a40f0042ad92d162e1c1b1bfed573d3c648419d8638f3963"} Jun 03 15:15:11.275764 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.275728 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89"] Jun 03 15:15:11.280543 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.280518 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.283990 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.283963 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 03 15:15:11.295237 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.295212 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89"] Jun 03 15:15:11.326015 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.325978 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.326183 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.326035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.326183 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.326069 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.326183 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.326155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.326183 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.326179 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzlt\" (UniqueName: \"kubernetes.io/projected/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-kube-api-access-tqzlt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.326349 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.326206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.427304 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.427267 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.427529 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.427317 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzlt\" (UniqueName: \"kubernetes.io/projected/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-kube-api-access-tqzlt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.427529 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.427434 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.427529 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.427506 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.427721 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.427553 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.427721 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.427616 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.427830 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.427768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.427957 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.427926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.428084 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.428010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.429951 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.429917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.430235 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.430218 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.444834 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.444807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzlt\" (UniqueName: \"kubernetes.io/projected/37c9e75d-4ae5-412a-ad6f-eb61e7f94053-kube-api-access-tqzlt\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89\" (UID: \"37c9e75d-4ae5-412a-ad6f-eb61e7f94053\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.591135 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.591094 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:11.728701 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:11.728670 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89"] Jun 03 15:15:11.731302 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:15:11.731260 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c9e75d_4ae5_412a_ad6f_eb61e7f94053.slice/crio-d479b5a381e9b17a2fee7803a971a5c3d8a14dc1492ad4926e3be485358753df WatchSource:0}: Error finding container d479b5a381e9b17a2fee7803a971a5c3d8a14dc1492ad4926e3be485358753df: Status 404 returned error can't find the container with id d479b5a381e9b17a2fee7803a971a5c3d8a14dc1492ad4926e3be485358753df Jun 03 15:15:12.541206 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:12.541170 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" event={"ID":"37c9e75d-4ae5-412a-ad6f-eb61e7f94053","Type":"ContainerStarted","Data":"9175a87c902348ffeb53e432301bee39aa587c0c6c833292b6ed1f312d55db42"} Jun 03 15:15:12.541664 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:12.541215 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" event={"ID":"37c9e75d-4ae5-412a-ad6f-eb61e7f94053","Type":"ContainerStarted","Data":"d479b5a381e9b17a2fee7803a971a5c3d8a14dc1492ad4926e3be485358753df"} Jun 03 15:15:12.542539 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:12.542514 2574 generic.go:358] "Generic (PLEG): container finished" podID="57f33aa3-64ef-448c-afe8-e0b2e1331cda" containerID="031396a0a317ee76a40f0042ad92d162e1c1b1bfed573d3c648419d8638f3963" exitCode=0 Jun 03 15:15:12.542636 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:12.542560 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" event={"ID":"57f33aa3-64ef-448c-afe8-e0b2e1331cda","Type":"ContainerDied","Data":"031396a0a317ee76a40f0042ad92d162e1c1b1bfed573d3c648419d8638f3963"} Jun 03 15:15:16.556936 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:16.556892 2574 generic.go:358] "Generic (PLEG): container finished" podID="37c9e75d-4ae5-412a-ad6f-eb61e7f94053" containerID="9175a87c902348ffeb53e432301bee39aa587c0c6c833292b6ed1f312d55db42" exitCode=0 Jun 03 15:15:16.557530 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:16.556955 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" event={"ID":"37c9e75d-4ae5-412a-ad6f-eb61e7f94053","Type":"ContainerDied","Data":"9175a87c902348ffeb53e432301bee39aa587c0c6c833292b6ed1f312d55db42"} Jun 03 15:15:18.565681 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:18.565643 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" event={"ID":"37c9e75d-4ae5-412a-ad6f-eb61e7f94053","Type":"ContainerStarted","Data":"37fb1477a1588aecb7a66c93d5bb2c500ac9b3c948839134192aef7f6d52fc41"} Jun 03 15:15:18.567184 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:18.567156 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" event={"ID":"57f33aa3-64ef-448c-afe8-e0b2e1331cda","Type":"ContainerStarted","Data":"b281e066dd220e5b642e0683a720f0bcf85b49477b9c533e59cef11d8dde0414"} Jun 03 15:15:18.587629 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:18.587566 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" podStartSLOduration=6.102652406 podStartE2EDuration="7.587552531s" podCreationTimestamp="2026-06-03 15:15:11 +0000 UTC" firstStartedPulling="2026-06-03 15:15:16.557732118 +0000 UTC m=+700.880889399" lastFinishedPulling="2026-06-03 15:15:18.042632241 +0000 UTC m=+702.365789524" observedRunningTime="2026-06-03 15:15:18.585806403 +0000 UTC m=+702.908963710" watchObservedRunningTime="2026-06-03 15:15:18.587552531 +0000 UTC m=+702.910709834" Jun 03 15:15:18.606508 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:18.606437 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" podStartSLOduration=1.5116091379999999 podStartE2EDuration="15.606424756s" podCreationTimestamp="2026-06-03 15:15:03 +0000 UTC" firstStartedPulling="2026-06-03 15:15:03.948346312 +0000 UTC m=+688.271503594" lastFinishedPulling="2026-06-03 15:15:18.043161929 +0000 UTC m=+702.366319212" observedRunningTime="2026-06-03 15:15:18.605172933 +0000 UTC m=+702.928330234" watchObservedRunningTime="2026-06-03 15:15:18.606424756 +0000 UTC m=+702.929582058" Jun 03 15:15:21.592029 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:21.591998 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:21.592029 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:21.592030 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:21.604962 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:21.604937 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:22.593383 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:22.593344 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89" Jun 03 15:15:23.810756 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:23.810721 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:23.811157 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:23.810802 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:23.823404 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:23.823377 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:24.601391 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:24.601359 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc" Jun 03 15:15:49.093613 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.093580 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj"] Jun 03 15:15:49.096654 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.096636 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.099871 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.099851 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 15:15:49.106210 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.106187 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj"] Jun 03 15:15:49.154626 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.154590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a16c948-ebaf-4e91-8394-4431bd493e01-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.154626 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.154631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.154822 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.154658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.154822 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.154753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.154910 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.154822 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnvjm\" (UniqueName: \"kubernetes.io/projected/4a16c948-ebaf-4e91-8394-4431bd493e01-kube-api-access-hnvjm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.154910 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.154851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256096 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256056 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hnvjm\" (UniqueName: \"kubernetes.io/projected/4a16c948-ebaf-4e91-8394-4431bd493e01-kube-api-access-hnvjm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256262 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256105 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256262 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256141 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a16c948-ebaf-4e91-8394-4431bd493e01-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256262 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256174 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256262 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256211 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256262 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256254 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256745 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256862 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.256862 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.256762 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.258555 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.258535 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a16c948-ebaf-4e91-8394-4431bd493e01-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.258926 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.258908 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a16c948-ebaf-4e91-8394-4431bd493e01-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.265245 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.265224 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnvjm\" (UniqueName: \"kubernetes.io/projected/4a16c948-ebaf-4e91-8394-4431bd493e01-kube-api-access-hnvjm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj\" (UID: \"4a16c948-ebaf-4e91-8394-4431bd493e01\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.406340 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.406244 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" Jun 03 15:15:49.548782 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.548755 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj"] Jun 03 15:15:49.551039 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:15:49.551003 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a16c948_ebaf_4e91_8394_4431bd493e01.slice/crio-2f9f73a9ead7612b0191d41629477d271da4096a59ea90c88de8d9a1208aaca5 WatchSource:0}: Error finding container 2f9f73a9ead7612b0191d41629477d271da4096a59ea90c88de8d9a1208aaca5: Status 404 returned error can't find the container with id 2f9f73a9ead7612b0191d41629477d271da4096a59ea90c88de8d9a1208aaca5 Jun 03 15:15:49.676680 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.676599 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" event={"ID":"4a16c948-ebaf-4e91-8394-4431bd493e01","Type":"ContainerStarted","Data":"1ca95167476cba89fa6ad7ba141f5de2f9193a7dfa3d9406cd06d56293230f9b"} Jun 03 15:15:49.676680 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:15:49.676637 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj" event={"ID":"4a16c948-ebaf-4e91-8394-4431bd493e01","Type":"ContainerStarted","Data":"2f9f73a9ead7612b0191d41629477d271da4096a59ea90c88de8d9a1208aaca5"} Jun 03 15:18:36.178503 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:18:36.178474 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:18:36.178955 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:18:36.178826 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7h852_b05f0926-3b3c-4130-9af5-7aac7591cdbd/ovn-acl-logging/0.log" Jun 03 15:21:40.123641 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:40.123589 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj_4a16c948-ebaf-4e91-8394-4431bd493e01/storage-initializer/0.log" Jun 03 15:21:41.089480 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:41.089432 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d879b5774-hnckv_20a368fc-6583-4deb-9c28-411e18e8be8f/authorino/0.log" Jun 03 15:21:46.096892 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:46.096857 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6848968976-srn7m_79529396-c5a3-4fa3-b341-330332c46a04/maas-api/0.log" Jun 03 15:21:46.329800 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:46.329767 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6766ccdb5b-72r82_75e4bbcd-7fb2-445c-98d5-ed39ead85500/manager/0.log" Jun 03 15:21:46.802901 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:46.802876 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-lh24g_ba050a0b-854b-46fb-8f8a-e72c76148896/copy-manifests/0.log" Jun 03 15:21:46.810415 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:46.810353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-lh24g_ba050a0b-854b-46fb-8f8a-e72c76148896/manager/0.log" Jun 03 15:21:47.042904 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:47.042874 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-txpcx_20c61016-582d-415f-9760-991e02c4660f/postgres/0.log" Jun 03 15:21:48.320802 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:48.320773 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d879b5774-hnckv_20a368fc-6583-4deb-9c28-411e18e8be8f/authorino/0.log" Jun 03 15:21:48.651433 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:48.651358 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-zsxkz_1832330e-cdf1-4a87-b204-32f6bbdfcbf6/kuadrant-console-plugin/0.log" Jun 03 15:21:48.886361 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:48.886306 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-vkfq9_ef39b6a6-df9c-49e6-8372-b434eaa93c8e/manager/0.log" Jun 03 15:21:49.814148 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:49.814120 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d85c64844-qdkt8_602ce5db-9b49-4fb0-8476-d46d0c87012d/kube-auth-proxy/0.log" Jun 03 15:21:50.040541 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:50.040490 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-vtptx_eb8883a2-6891-468c-a92b-3be29ff87a14/payload-processing/0.log" Jun 03 15:21:50.726384 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:50.726348 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc_57f33aa3-64ef-448c-afe8-e0b2e1331cda/storage-initializer/0.log" Jun 03 15:21:50.734153 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:50.734123 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84f46c7fb4-dg4mc_57f33aa3-64ef-448c-afe8-e0b2e1331cda/main/0.log" Jun 03 15:21:50.850305 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:50.850278 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89_37c9e75d-4ae5-412a-ad6f-eb61e7f94053/main/0.log" Jun 03 15:21:50.858216 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:50.858196 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-bdd7f9n4w89_37c9e75d-4ae5-412a-ad6f-eb61e7f94053/storage-initializer/0.log" Jun 03 15:21:51.094205 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:51.094166 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-pltfj_4a16c948-ebaf-4e91-8394-4431bd493e01/storage-initializer/0.log" Jun 03 15:21:58.718194 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:58.718161 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wdhf8_2039603c-658b-453a-a073-7870997f32a5/global-pull-secret-syncer/0.log" Jun 03 15:21:58.867429 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:58.867398 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hgmns_a0c5d0aa-a851-4211-aff4-de66208c444b/konnectivity-agent/0.log" Jun 03 15:21:58.948351 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:21:58.948308 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-0.ec2.internal_4d995b3d7a98c9f98d9fa0e379217d6a/haproxy/0.log" Jun 03 15:22:03.386359 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:03.386326 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5d879b5774-hnckv_20a368fc-6583-4deb-9c28-411e18e8be8f/authorino/0.log" Jun 03 15:22:03.485886 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:03.485862 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-zsxkz_1832330e-cdf1-4a87-b204-32f6bbdfcbf6/kuadrant-console-plugin/0.log" Jun 03 15:22:03.620140 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:03.620113 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-vkfq9_ef39b6a6-df9c-49e6-8372-b434eaa93c8e/manager/0.log" Jun 03 15:22:05.397002 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.396969 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-smdgj_82bf64c8-a17d-40e1-9409-a44e6d736eb6/kube-state-metrics/0.log" Jun 03 15:22:05.422600 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.422565 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-smdgj_82bf64c8-a17d-40e1-9409-a44e6d736eb6/kube-rbac-proxy-main/0.log" Jun 03 15:22:05.452984 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.452953 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-smdgj_82bf64c8-a17d-40e1-9409-a44e6d736eb6/kube-rbac-proxy-self/0.log" Jun 03 15:22:05.551584 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.551559 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-fs8k4_248dd05d-fba4-4629-ba1e-0bf8f49d0324/monitoring-plugin/0.log" Jun 03 15:22:05.737895 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.737818 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhmzs_bc6e069e-2819-404a-a2b9-299cc9209a27/node-exporter/0.log" Jun 03 15:22:05.759070 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.759022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhmzs_bc6e069e-2819-404a-a2b9-299cc9209a27/kube-rbac-proxy/0.log" Jun 03 15:22:05.779945 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.779917 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vhmzs_bc6e069e-2819-404a-a2b9-299cc9209a27/init-textfile/0.log" Jun 03 15:22:05.803932 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.803903 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bqnf6_81b9b4b9-f68b-4f13-a456-9d911e1ee25a/kube-rbac-proxy-main/0.log" Jun 03 15:22:05.828117 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.828090 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bqnf6_81b9b4b9-f68b-4f13-a456-9d911e1ee25a/kube-rbac-proxy-self/0.log" Jun 03 15:22:05.852224 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.852198 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-bqnf6_81b9b4b9-f68b-4f13-a456-9d911e1ee25a/openshift-state-metrics/0.log" Jun 03 15:22:05.916251 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.916228 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2a7d768-c503-45f1-8049-b4f6bea04dbe/prometheus/0.log" Jun 03 15:22:05.945822 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.945761 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2a7d768-c503-45f1-8049-b4f6bea04dbe/config-reloader/0.log" Jun 03 15:22:05.970063 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.970026 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2a7d768-c503-45f1-8049-b4f6bea04dbe/thanos-sidecar/0.log" Jun 03 15:22:05.994110 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:05.994049 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2a7d768-c503-45f1-8049-b4f6bea04dbe/kube-rbac-proxy-web/0.log" Jun 03 15:22:06.018061 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:06.018031 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2a7d768-c503-45f1-8049-b4f6bea04dbe/kube-rbac-proxy/0.log" Jun 03 15:22:06.048112 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:06.048085 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2a7d768-c503-45f1-8049-b4f6bea04dbe/kube-rbac-proxy-thanos/0.log" Jun 03 15:22:06.081414 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:06.081390 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a2a7d768-c503-45f1-8049-b4f6bea04dbe/init-config-reloader/0.log" Jun 03 15:22:08.088906 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.088866 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599"] Jun 03 15:22:08.092499 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.092476 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.095615 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.095589 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7kqc\"/\"openshift-service-ca.crt\"" Jun 03 15:22:08.097114 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.097098 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n7kqc\"/\"kube-root-ca.crt\"" Jun 03 15:22:08.097114 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.097105 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n7kqc\"/\"default-dockercfg-glhxv\"" Jun 03 15:22:08.102882 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.102856 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599"] Jun 03 15:22:08.179714 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.179677 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-lib-modules\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.179714 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.179713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnv77\" (UniqueName: \"kubernetes.io/projected/1a72858d-3978-433e-88fa-74613ce8bc9a-kube-api-access-jnv77\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.179919 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.179813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-sys\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.179919 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.179862 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-podres\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.179919 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.179902 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-proc\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280682 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280644 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-sys\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280694 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-podres\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280719 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-proc\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280761 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-lib-modules\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280775 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-sys\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280784 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jnv77\" (UniqueName: \"kubernetes.io/projected/1a72858d-3978-433e-88fa-74613ce8bc9a-kube-api-access-jnv77\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-proc\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-podres\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.280897 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.280890 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1a72858d-3978-433e-88fa-74613ce8bc9a-lib-modules\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.289988 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.289951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnv77\" (UniqueName: \"kubernetes.io/projected/1a72858d-3978-433e-88fa-74613ce8bc9a-kube-api-access-jnv77\") pod \"perf-node-gather-daemonset-zg599\" (UID: \"1a72858d-3978-433e-88fa-74613ce8bc9a\") " pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.403180 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.403093 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.556290 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.556266 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599"] Jun 03 15:22:08.559238 ip-10-0-133-0 kubenswrapper[2574]: W0603 15:22:08.559213 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1a72858d_3978_433e_88fa_74613ce8bc9a.slice/crio-44cf97c65faea59ffd10e3be86d6e97de6d1ad9afc1b7cc1906497ce35eb2f92 WatchSource:0}: Error finding container 44cf97c65faea59ffd10e3be86d6e97de6d1ad9afc1b7cc1906497ce35eb2f92: Status 404 returned error can't find the container with id 44cf97c65faea59ffd10e3be86d6e97de6d1ad9afc1b7cc1906497ce35eb2f92 Jun 03 15:22:08.561220 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.561205 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 15:22:08.950513 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.950480 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" event={"ID":"1a72858d-3978-433e-88fa-74613ce8bc9a","Type":"ContainerStarted","Data":"02ef8cda48132dfa5ba466d78d8dffac370867be311cc5b8121b5c163824b60c"} Jun 03 15:22:08.950513 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.950517 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" event={"ID":"1a72858d-3978-433e-88fa-74613ce8bc9a","Type":"ContainerStarted","Data":"44cf97c65faea59ffd10e3be86d6e97de6d1ad9afc1b7cc1906497ce35eb2f92"} Jun 03 15:22:08.950785 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.950554 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:08.970651 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:08.970602 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" podStartSLOduration=0.970587068 podStartE2EDuration="970.587068ms" podCreationTimestamp="2026-06-03 15:22:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:22:08.968416176 +0000 UTC m=+1113.291573480" watchObservedRunningTime="2026-06-03 15:22:08.970587068 +0000 UTC m=+1113.293744371" Jun 03 15:22:10.028881 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:10.028849 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6bj54_2b670147-10da-493d-93c6-eeb1a139faa3/dns/0.log" Jun 03 15:22:10.052433 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:10.052408 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6bj54_2b670147-10da-493d-93c6-eeb1a139faa3/kube-rbac-proxy/0.log" Jun 03 15:22:10.198261 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:10.198232 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fn9pw_04c78b61-5379-4edb-8c49-40f541af95ff/dns-node-resolver/0.log" Jun 03 15:22:10.760039 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:10.760004 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-42xcc_eb9ee7ed-f607-49c8-a1d4-51d74b749ae7/node-ca/0.log" Jun 03 15:22:11.937371 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:11.937341 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6d85c64844-qdkt8_602ce5db-9b49-4fb0-8476-d46d0c87012d/kube-auth-proxy/0.log" Jun 03 15:22:11.997866 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:11.997839 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-vtptx_eb8883a2-6891-468c-a92b-3be29ff87a14/payload-processing/0.log" Jun 03 15:22:12.623884 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:12.623841 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s84xw_5ac74856-af86-4feb-bf55-93666990a7f9/serve-healthcheck-canary/0.log" Jun 03 15:22:13.212887 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:13.212861 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnccz_c7aef073-850c-472e-9d51-2dd26e956861/kube-rbac-proxy/0.log" Jun 03 15:22:13.235033 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:13.235006 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnccz_c7aef073-850c-472e-9d51-2dd26e956861/exporter/0.log" Jun 03 15:22:13.265711 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:13.265681 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qnccz_c7aef073-850c-472e-9d51-2dd26e956861/extractor/0.log" Jun 03 15:22:14.964107 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:14.964078 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n7kqc/perf-node-gather-daemonset-zg599" Jun 03 15:22:15.529009 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:15.528978 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-6848968976-srn7m_79529396-c5a3-4fa3-b341-330332c46a04/maas-api/0.log" Jun 03 15:22:15.579363 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:15.579306 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6766ccdb5b-72r82_75e4bbcd-7fb2-445c-98d5-ed39ead85500/manager/0.log" Jun 03 15:22:15.807911 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:15.807820 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-lh24g_ba050a0b-854b-46fb-8f8a-e72c76148896/manager/0.log" Jun 03 15:22:15.828136 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:15.828111 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5678f4b79b-lh24g_ba050a0b-854b-46fb-8f8a-e72c76148896/copy-manifests/0.log" Jun 03 15:22:15.896476 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:15.896419 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-68c4fbbd6f-txpcx_20c61016-582d-415f-9760-991e02c4660f/postgres/0.log" Jun 03 15:22:17.475826 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:17.475796 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f7c5db56c-t2x9k_1bdc95c7-8334-4907-87e0-21b9599a1290/manager/0.log" Jun 03 15:22:17.522783 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:17.522676 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-bfc7f696d-lrpbg_dbf65ad5-8051-45aa-845e-7be369fff94e/openshift-lws-operator/0.log" Jun 03 15:22:24.059744 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.059665 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8d6rh_06fbd415-d46a-4f1a-bb7b-dfa988b6706c/kube-multus/0.log" Jun 03 15:22:24.236855 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.236819 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbgd7_0d75de24-f4bf-4127-b84e-cf5288119dd4/kube-multus-additional-cni-plugins/0.log" Jun 03 15:22:24.256658 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.256616 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbgd7_0d75de24-f4bf-4127-b84e-cf5288119dd4/egress-router-binary-copy/0.log" Jun 03 15:22:24.277894 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.277863 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbgd7_0d75de24-f4bf-4127-b84e-cf5288119dd4/cni-plugins/0.log" Jun 03 15:22:24.296924 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.296898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbgd7_0d75de24-f4bf-4127-b84e-cf5288119dd4/bond-cni-plugin/0.log" Jun 03 15:22:24.316747 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.316660 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbgd7_0d75de24-f4bf-4127-b84e-cf5288119dd4/routeoverride-cni/0.log" Jun 03 15:22:24.340086 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.340066 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbgd7_0d75de24-f4bf-4127-b84e-cf5288119dd4/whereabouts-cni-bincopy/0.log" Jun 03 15:22:24.360000 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.359973 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pbgd7_0d75de24-f4bf-4127-b84e-cf5288119dd4/whereabouts-cni/0.log" Jun 03 15:22:24.562813 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.562786 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8gfc9_2d264119-1673-43ed-817f-de832fc810c9/network-metrics-daemon/0.log" Jun 03 15:22:24.582047 ip-10-0-133-0 kubenswrapper[2574]: I0603 15:22:24.582019 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8gfc9_2d264119-1673-43ed-817f-de832fc810c9/kube-rbac-proxy/0.log"